-- Logs begin at Wed 2022-07-13 08:16:29 UTC, end at Wed 2022-07-13 09:14:24 UTC. -- Jul 13 08:42:24.086382 dv-cinder-849626-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 08:42:24.094917 dv-cinder-849626-3-smb devstack@keystone.service[80098]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 08:42:24 2022] *** Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: nodename: dv-cinder-849626-3-smb Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: machine: x86_64 Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: clock source: unix Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: pcre jit disabled Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: detected number of CPU cores: 4 Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: current working directory: / Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: detected binary path: /usr/bin/uwsgi-core Jul 13 08:42:24.096910 dv-cinder-849626-3-smb devstack@keystone.service[80098]: your processes number limit is 47680 Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: your memory page size is 4096 bytes Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: detected max file descriptor number: 2048 Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: lock engine: pthread robust mutexes Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: thunder lock: enabled Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 08:42:24.097545 dv-cinder-849626-3-smb devstack@keystone.service[80098]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 08:42:24.141405 dv-cinder-849626-3-smb devstack@keystone.service[80098]: Python main interpreter initialized at 0x55fc0ee139c0 Jul 13 08:42:24.141405 dv-cinder-849626-3-smb devstack@keystone.service[80098]: python threads support enabled Jul 13 08:42:24.141405 dv-cinder-849626-3-smb devstack@keystone.service[80098]: your server socket listen backlog is limited to 100 connections Jul 13 08:42:24.141405 dv-cinder-849626-3-smb devstack@keystone.service[80098]: your mercy for graceful operations on workers is 90 seconds Jul 13 08:42:24.141723 dv-cinder-849626-3-smb devstack@keystone.service[80098]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 08:42:24.141830 dv-cinder-849626-3-smb devstack@keystone.service[80098]: *** Operational MODE: preforking *** Jul 13 08:42:24.142102 dv-cinder-849626-3-smb devstack@keystone.service[80098]: *** uWSGI is running in multiple interpreter mode *** Jul 13 08:42:24.142102 dv-cinder-849626-3-smb devstack@keystone.service[80098]: spawned uWSGI master process (pid: 80098) Jul 13 08:42:24.142316 dv-cinder-849626-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 13 08:42:24.144260 dv-cinder-849626-3-smb devstack@keystone.service[80098]: spawned uWSGI worker 1 (pid: 80112, cores: 1) Jul 13 08:42:24.144260 dv-cinder-849626-3-smb devstack@keystone.service[80098]: spawned uWSGI worker 2 (pid: 80113, cores: 1) Jul 13 08:42:24.144260 dv-cinder-849626-3-smb devstack@keystone.service[80098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 08:42:29.565140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:42:29.565140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: from cryptography.utils import int_from_bytes Jul 13 08:42:29.565915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:42:29.565915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: from cryptography.utils import int_from_bytes Jul 13 08:42:29.566386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:42:29.566386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: from cryptography.utils import int_from_bytes Jul 13 08:42:29.566519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:42:29.566519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: from cryptography.utils import int_from_bytes Jul 13 08:42:29.614806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:42:29.615004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:42:29.615192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] command line args: [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:42:29.615283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:42:29.615450 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:42:29.615536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:42:29.615620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ================================================================================ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:42:29.615697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] command line args: [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:42:29.615857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] admin_token = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.615963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:42:29.616100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_dir = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ================================================================================ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:42:29.616284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] admin_token = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_source = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] debug = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_dir = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.616820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_source = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] debug = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.617870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_config_append = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.618843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_dir = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619062 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_config_append = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.619977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_dir = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.620955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.621901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] publish_errors = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.622953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] publish_errors = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.623912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] standard_threads = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_journal = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.624884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_json = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_stderr = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_syslog = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] standard_threads = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.625933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.625933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.626189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.626312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_journal = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.626433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.626549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_json = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.626663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.626776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_stderr = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.626776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_syslog = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.627010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:42:29.627245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627718 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.627944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628062 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.628996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.629941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.630955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.631888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.632917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.633987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.634949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.635870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.636984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.637918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.638897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.639622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.640913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.641942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.642910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.643965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.644998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.645928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.646917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.647739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.648981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.649922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.external = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.650901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.password = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.651934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.token = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.external = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.652928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.password = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.653986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.token = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.654976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.655097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.655219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.655368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.656942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.657986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.658974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.659900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.660984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.661939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.662900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.663967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.664887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.665943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.666945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.667994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.668924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.669977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.670988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.671932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.672977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.673904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.674983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.675988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.676949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.677970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.678985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.679876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.680973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.681998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.682945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.683894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.684986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.685972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.686987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.687956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.688856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.689974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690062 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.690929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.691949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.692886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.693963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.694965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.695995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.696924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.697867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.698967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.699049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.699122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:42:29.699230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.699475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.699710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.699962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.700199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.700447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.700684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.700927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.701157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.701397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.701632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:42:29.701803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:42:29.730498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.730724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.730958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.732240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.732481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.732711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.739888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.741316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.768286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.768510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.769807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.770041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.910479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.910719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.959814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.960046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.960265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:29.960499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.024427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.024659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.024852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.024944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.025944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.050489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.050725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.050939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.051913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.052040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.052251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.063480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.063649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.076320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.076544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.076640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.076790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.076875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.077017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.077104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.077777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.077885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.078006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.078092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.078249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.078334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.078464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:42:30.095646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.095860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:42:30.096198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.096401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:42:30.096578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.096678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.096787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:42:30.096914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.097116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.097199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.097312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:42:30.097398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.097573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.097826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.098075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.098351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.108897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.110866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.110866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.111540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.111625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.111727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.111727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.111727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.118053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.120786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.121394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.121677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.121960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.122271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.122933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.123977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.124709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.124804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.124976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.125239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.151629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.151751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.153261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.153353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.153544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.153631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.158912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.159002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.159189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.159274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.159581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.159665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.167172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.167268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.167404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.167506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.172413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.172510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.172695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.172781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.172974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.173872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.174046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.174161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.174329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.174427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.193660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.193755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.193938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.194025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.198549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.198639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.202199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.202295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.202488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.202587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.207603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.207696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.211236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.211329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.214872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.214993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.215900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.216018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.216187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.216271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.216464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.235816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.236096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.236181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.236357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.236456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.236615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.236700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.236965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.244532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.244971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.246261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.246538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.246727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.247006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.250283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.250560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.250790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.250875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.251919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.264560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.264862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.265139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.265294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.265422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.265576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.265696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.265862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.266180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.266464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.267277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.267565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.268054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.268344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.285446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.286424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.288753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.289730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.292356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.293360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.294376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.295151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.296518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.296794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.297077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.297328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.297611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.297899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.304364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.305320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.305970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.307005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.309209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.309497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.309883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.310195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.310317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.310556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.310951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.311233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.319985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.320275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.320552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.321018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.321309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.321594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.328742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.329019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.329297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.329569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.329653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:42:30.329837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.329922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.330774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.331912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.332917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.333185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:42:30.370646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc0ee139c0 pid: 80113 (default app) Jul 13 08:42:30.371632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc0ee139c0 pid: 80112 (default app) Jul 13 08:42:30.373966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8600-31fb-4339-93c8-ec708d612256 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:30.374817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8600-31fb-4339-93c8-ec708d612256 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:30.375094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c8600-31fb-4339-93c8-ec708d612256 None None] PATH_INFO: `/v3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:30.379332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Jul 13 08:42:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:38.005993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.006582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.006582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.010916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:38.016124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.016538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.016688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.086200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: INFO dbcounter [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] Registered counter for database keystone Jul 13 08:42:38.107505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG oslo_db.sqlalchemy.engines [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:42:38.114479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writer thread running {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:42:38.288146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG passlib.handlers.bcrypt [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 08:42:38.288572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG passlib.handlers.bcrypt [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 08:42:38.342250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:38.344442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:38.464910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 13 08:42:38.680049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.750740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: INFO dbcounter [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] Registered counter for database keystone Jul 13 08:42:38.770292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG oslo_db.sqlalchemy.engines [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:42:38.776363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writer thread running {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 08:42:38.893858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32acc-99c4-47a5-9d82-57c30042225d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.898106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.898794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.899080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.899357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.907387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.958784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 08:42:38.959071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897c84-3f04-413a-8db4-ba10f590d8a0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.968580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Jul 13 08:42:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:42:38.974647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.988793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e8c3-4ea8-4204-b0dd-42aa968a8125 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.993097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.994238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.994526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.994799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] PATH_INFO: `/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.996289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] RBAC: Authorizing `identity:get_project(project_id=ae57fca42c7a4eb0ba3859bea8e9d888)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:39.049149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 08:42:39.049683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9bdf3-7047-459e-ad58-1236a96e9e4c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:39.054009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Jul 13 08:42:38 2022] GET /identity/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:41.052295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f3b20-0186-4bb1-a8df-553325cc8c3a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:41.052827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f3b20-0186-4bb1-a8df-553325cc8c3a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:41.052827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f3b20-0186-4bb1-a8df-553325cc8c3a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:41.056949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:41.062184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:41.062610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:41.062740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:41.080846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:41.082394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:41.090055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 08:42:41.113253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f3b20-0186-4bb1-a8df-553325cc8c3a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:41.125329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f3b20-0186-4bb1-a8df-553325cc8c3a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:41.129453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:41.130087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:41.130406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:41.130684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:41.138367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:41.140134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c685a-4c73-4c9a-917b-4353906315b8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:41.148800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Jul 13 08:42:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:42:41.154037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:41.163492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149508c-ddf8-4be5-ac7c-1ff871db1647 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:41.168078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:41.168936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:41.169215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:41.169487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:41.171510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:41.173316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeba45-44c7-4d85-a391-3f5358e83279 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:41.174901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Jul 13 08:42:41 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:43.216489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ece07-9fbb-4e59-880a-bf835882a056 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.216989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ece07-9fbb-4e59-880a-bf835882a056 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.217089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ece07-9fbb-4e59-880a-bf835882a056 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.219054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:43.224038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.224419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.224590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.240713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:43.241883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:43.278253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db889e-696e-4fcf-a78e-8a09cd559a2e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.278545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db889e-696e-4fcf-a78e-8a09cd559a2e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.278832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db889e-696e-4fcf-a78e-8a09cd559a2e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.280181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:42:43.285204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.285490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.285770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.325259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:43.325744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG passlib.handlers.bcrypt [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80112) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 08:42:43.326188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG passlib.handlers.bcrypt [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80112) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 08:42:43.348377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.371025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:43.371750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:43.373349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:43.449217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb27cac-ced8-41c1-ace6-9fabfbeb4f3f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.473188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:42:43.481719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.482542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.482827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.483360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.494521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:43.494782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:43.506264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:43.507166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:42:43.507962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:42:43.515032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.595225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:43.597223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab61bb-bb9f-497a-81c9-280bf75edcbf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.599576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:43.614512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ed8e0-0063-4803-9397-a54a2140c57b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.635520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.636362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.636653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.636933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.647324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.647987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.648270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.648547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.649291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:43.649598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:43.651018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:43.662495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:43.668156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.702885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:43.704407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:43.767007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bde7b-d600-4dff-92e7-c00d87aba6f5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.799359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.799539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:42:43.800228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.800517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.800795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.802015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:43.803509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:43.805122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:43.805242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.810031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.810544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:43.825099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:43.904807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac9b1-7b29-458e-9fa6-2ba820e7ba7c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.905984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ffe4-b437-4c12-b44f-6fa2edd309c5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:43.938091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.938476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:43.939009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.939256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:43.939348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.939587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.939685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:43.939862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:43.941027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:43.942479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:43.944053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:43.949543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:43.957846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:43.959358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:42:43.981977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:43.982898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:43.984331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:42:43.984331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:42:43.984331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:42:43.984331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:42:43.984331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:42:43.990411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:44.028961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:44.045570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:44.051106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2acc3-c224-49d9-9bef-fa3c7805ae7e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:44.083977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:44.084637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:44.084923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:44.085203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:44.086035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.domain.id=default, user.id=251b3f8442ad41018807bed6ecb8c581) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:44.086379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:44.087809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8a2-454b-4ddc-aca8-322b2ff2b76c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:44.087923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce6ee-6b40-4f76-9df1-06dc14aea12c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:44.095110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/role_assignments?user.id=251b3f8442ad41018807bed6ecb8c581&scope.domain.id=default&role.id=e3ea2fe66d56423a93654b34570d047c => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:44.124910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:44.125605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:44.125890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:44.126203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:44.126958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:44.127267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:44.128711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350be28e-726d-4502-880e-78e98c51e627 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:44.148330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:46.545401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef70-28b0-45d3-951d-7289663b2634 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.546986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef70-28b0-45d3-951d-7289663b2634 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.547513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef70-28b0-45d3-951d-7289663b2634 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.549099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:46.554665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65006-a05d-4d41-93f7-69c2df3d92c7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.555073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65006-a05d-4d41-93f7-69c2df3d92c7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.555224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65006-a05d-4d41-93f7-69c2df3d92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.578215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1cf65006-a05d-4d41-93f7-69c2df3d92c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:46.579667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1cf65006-a05d-4d41-93f7-69c2df3d92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:46.594874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45ddf-9889-42a9-a6df-07eb56f7ab23 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.595837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45ddf-9889-42a9-a6df-07eb56f7ab23 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.596325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45ddf-9889-42a9-a6df-07eb56f7ab23 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.598468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:46.610831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1de77-1263-4bb5-9cd7-eb779037a53a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.611415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1de77-1263-4bb5-9cd7-eb779037a53a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.611894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1de77-1263-4bb5-9cd7-eb779037a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.643108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bad1de77-1263-4bb5-9cd7-eb779037a53a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:46.645763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bad1de77-1263-4bb5-9cd7-eb779037a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:46.708586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:46.743993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875ac1-9ca1-4546-b804-5e154f9176b6 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.744605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875ac1-9ca1-4546-b804-5e154f9176b6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.745090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68875ac1-9ca1-4546-b804-5e154f9176b6 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.746467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:42:46.747070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 12/26] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:42:46.753876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.754446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.754931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.763416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68875ac1-9ca1-4546-b804-5e154f9176b6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:46.793135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:46.794744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:46.835017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:46.892829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68875ac1-9ca1-4546-b804-5e154f9176b6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:46.912561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:46.913405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:46.921954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:46.969540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:46.970369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.970653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.970929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.995888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:47.017466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:47.018586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 13/28] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:47.019566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.089765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9da07-4655-4d9d-86a2-50b105bde34b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.129814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.130636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.131232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.131659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.144943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.147143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.151254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de220e-efdf-4c0b-a228-099b8a8367c9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.159018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:42:47.171118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:47.172087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:47.173086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:42:47.173086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:42:47.173086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:42:47.173086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:42:47.174628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 16/29] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:47.175521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.196028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.196827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.197211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.197685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.198667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.200271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.238383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.283050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468626e-1869-4159-a170-bb9dc08636c7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.317077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.317948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.318420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.318833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.319711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:47.320154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.321729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dbe23-be1b-4326-9cdb-48b85fbc9d93 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.330703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 17/30] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:47.332120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab8be-9ef9-42cd-8be3-c18d92625c0d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.332549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab8be-9ef9-42cd-8be3-c18d92625c0d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.332967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab8be-9ef9-42cd-8be3-c18d92625c0d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.334353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 18/31] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:47.335186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab8be-9ef9-42cd-8be3-c18d92625c0d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.339459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 14/32] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jul 13 08:42:47 2022] POST /identity/v3/roles => generated 219 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:47.340908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.447668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab8be-9ef9-42cd-8be3-c18d92625c0d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.461229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5b5ad-fbc2-46ef-b373-7ef6ecdfe7fc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.466696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.485645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.486654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.487137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.487580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.488495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:47.488973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.490558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc0dce-9441-48c0-a89e-5752c7a7311c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.505728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.506894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.507499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.508024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.510217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.515004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 19/33] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:47.515004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.515004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.515004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.517151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.519877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 15/34] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:47 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:47.521350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.529839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:47.531194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:47.563697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.602648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 20/35] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:47.603432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.646908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e368a-e7ba-4fec-a401-a7768b48d31a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.695909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.697194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.698389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.698629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.699380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.700841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.733940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 16/36] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:42:47 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:47.734980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.739176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1852e-e495-4f70-9713-1bc1750ddcf7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.751192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.782951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.784028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.784486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.784865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.786716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.788324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.790102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 21/37] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:47.797316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.835392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:47.854193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a644-8b46-40e7-9d5c-73fa69429bf6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.891479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.892446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.892879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.893304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.894265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.895968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5e990-eeca-4b32-a769-bce9ef2955d1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.914547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 17/38] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jul 13 08:42:47 2022] POST /identity/v3/roles => generated 225 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:47.916875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ced-2b4a-4138-ab69-e91a86b271ec None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.958436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.959527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.959933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.960377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] PATH_INFO: `/v3/domains/default/users/251b3f8442ad41018807bed6ecb8c581/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.962848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=251b3f8442ad41018807bed6ecb8c581, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.964624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a15ad-e3ca-40c7-a462-1e598790bf3e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.967335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1082-f4c2-449c-ab63-cf052c2ccb79 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.968430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1082-f4c2-449c-ab63-cf052c2ccb79 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.968858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb1082-f4c2-449c-ab63-cf052c2ccb79 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.970818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 18/39] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:47.980928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.981464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.981918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.011868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:48.013460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:48.098555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:48.129648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:48.214197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:48.233807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Jul 13 08:42:47 2022] PUT /identity/v3/domains/default/users/251b3f8442ad41018807bed6ecb8c581/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:48.239788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dc94e-dafe-40a9-a466-db59e9027864 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:48.278401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:48.279101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:48.279390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:48.279672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.281178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:48.282658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ba06-97ec-48e9-a7c5-dafcf6487eaf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:48.298901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 20/42] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jul 13 08:42:48 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:48.327953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9de87-5686-4c34-9712-a70974c71b0b None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:48.328273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9de87-5686-4c34-9712-a70974c71b0b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:48.328534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9de87-5686-4c34-9712-a70974c71b0b None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.333308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 23/43] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:48.339130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:48.339436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:48.339856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.358883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:48.360283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:48.437374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:48.460826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9de87-5686-4c34-9712-a70974c71b0b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:48.499405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:48.567919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9de87-5686-4c34-9712-a70974c71b0b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:48.600894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:48.601719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:48.602007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:48.602314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.603590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:48.605168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946209a-009d-4f73-af6c-6d9c16190714 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:48.606838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:48.612621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:48.676981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:48.712632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929feb-6aa2-428f-941e-1428975c5a66 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:48.745004 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:48.745665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:48.745951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:48.746265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:48.746974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:48.748422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a0ae8-aa30-4e88-a179-348ff70550b0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:48.772993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:42:48 2022] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:50.244679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e445a4-a11a-465c-ba7f-98b26e36147f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.245177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e445a4-a11a-465c-ba7f-98b26e36147f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.245256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e445a4-a11a-465c-ba7f-98b26e36147f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.246652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:50.252330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.252735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.252885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.269648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:50.270838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:50.335334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:50.357780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e445a4-a11a-465c-ba7f-98b26e36147f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.456324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e445a4-a11a-465c-ba7f-98b26e36147f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:50.458543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:50.490135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:50.490950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.491234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.491518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.502068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:50.509579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:50.510429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:42:50.511409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:50.516460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.563653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:50.619645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46442a-2918-473e-aa4d-173a910eaa15 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:50.652842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:50.653515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.653805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.654086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.654875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:50.655184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:50.656579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdcea-f93b-4311-a7d8-e187f3add2d6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:50.668001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 24/50] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:50.674138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.769976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edd634-9efd-4506-be52-1524c93af811 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:50.780322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de181b5-3383-4fa5-a40b-5328985dd7ab None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.780684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de181b5-3383-4fa5-a40b-5328985dd7ab None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.781040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de181b5-3383-4fa5-a40b-5328985dd7ab None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.782526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 25/51] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:42:50.787367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.787658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.787940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.805293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:50.805620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:50.806514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:50.806630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.806796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.807088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.808344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:50.809784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:50.815782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:50.816792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.849021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:50.876999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 26/53] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:42:50.899738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.919657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48babb4f-cb15-44a4-896b-b3cb96c0847d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:50.953255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:50.954084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.954411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.954684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.955959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:50.957466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:50.959209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:50.965376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.043456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:51.065553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:51.068603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af091bf-0abf-4a09-893b-a7317bb7e9ca None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.101666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.102247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60a0c-8b03-45cd-85bf-b67707f2104a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.102446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.102731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.103006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.103828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.domain.id=default, user.id=251b3f8442ad41018807bed6ecb8c581) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:51.104134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.105571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.114155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/role_assignments?user.id=251b3f8442ad41018807bed6ecb8c581&scope.domain.id=default&role.id=e3ea2fe66d56423a93654b34570d047c => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:51.141161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.141995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.142340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.142626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.143891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.145386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3e5a2-fc49-4166-a62f-4a1a709eb79d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.147131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 27/56] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:51.153741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.255873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74399158-c808-474c-b01a-b0a24e2fc4de None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.290924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.291841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.292124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.292399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.293117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.294731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb62211-a102-4f39-9e04-6335bee871e6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.321341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 30/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Jul 13 08:42:51 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:53.315564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f5c9f-458f-4c36-a5fb-aedae1e14edf None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:53.316060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f5c9f-458f-4c36-a5fb-aedae1e14edf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:53.316144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f5c9f-458f-4c36-a5fb-aedae1e14edf None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:53.317499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 28/58] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:53.322836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:53.323219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:53.323410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:53.339967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:53.341486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:53.352219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:53.407030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:53.430800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f5c9f-458f-4c36-a5fb-aedae1e14edf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:53.527376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f5c9f-458f-4c36-a5fb-aedae1e14edf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:53.536645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:53.560599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:53.561402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:53.561687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:53.561967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:53.563151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:53.564581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d442e-c95b-48c2-9a73-6cb73e52a803 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:53.566190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 29/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:53.571635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:53.666098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34e0f-0472-4876-9f61-0d68c4435c58 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:53.698402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:53.699064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:53.699345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:53.699618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:53.700318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:53.702272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f110-68c3-41f2-b490-27ef262750cd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:53.726782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 32/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:42:53 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:56.837084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde8c0-a39a-4f20-aaeb-345424343a27 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:56.838084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde8c0-a39a-4f20-aaeb-345424343a27 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:56.838637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde8c0-a39a-4f20-aaeb-345424343a27 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:56.840220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 30/62] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:56.845927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:56.846798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:56.847276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:56.855848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:56.871153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:56.872388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:56.905514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3ecb-6c14-4817-988c-95a9290d3827 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:56.906154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3ecb-6c14-4817-988c-95a9290d3827 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:56.906656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3ecb-6c14-4817-988c-95a9290d3827 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:56.908216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:42:56.913107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296382d5-42e7-4634-85a0-428e68ed54c1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:56.913609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296382d5-42e7-4634-85a0-428e68ed54c1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:56.914090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296382d5-42e7-4634-85a0-428e68ed54c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:56.931165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-296382d5-42e7-4634-85a0-428e68ed54c1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:56.932690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-296382d5-42e7-4634-85a0-428e68ed54c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:56.981563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 33/64] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:57.005743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.031424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 32/65] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:42:57.033226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d55ea8-13f0-4e56-a523-a6ccbaf88978 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.033731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d55ea8-13f0-4e56-a523-a6ccbaf88978 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.034231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d55ea8-13f0-4e56-a523-a6ccbaf88978 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.035682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 33/66] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:57.051882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.052431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.052936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.074653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:57.076064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:57.142144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fd56-5600-4c97-8a25-31339b3c932e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.163464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:42:57.164734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.169593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.174703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.175509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.175811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.176075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.187066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:57.194713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:57.195727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:42:57.196475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:42:57.198889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 34/68] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:42:57.204525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.205808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.274928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a520e-ffda-4804-802c-eff064a9af11 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.310104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.311209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.311499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.311843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.319748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d810-6690-4e13-a885-e63f596d4557 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.321926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:57.330566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:57.331424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:57.334862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.361311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.362349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.362908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.363278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.373735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d25fcc64-4ac0-4bc2-98ba-dcc8802b8533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:57.381404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:57.382270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:42:57.383017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 35/70] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:57.384228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aad0c-65f3-474c-982e-7bdbcb96bb93 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.384228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aad0c-65f3-474c-982e-7bdbcb96bb93 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.384486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aad0c-65f3-474c-982e-7bdbcb96bb93 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.385896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 36/71] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:57.391115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aad0c-65f3-474c-982e-7bdbcb96bb93 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.437475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.444863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9f58-a74c-457b-af2c-8bdc03580515 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.451259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.486918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.487599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.487890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.488583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.489492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:57.489944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.491841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.501217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aad0c-65f3-474c-982e-7bdbcb96bb93 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.502672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.503464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.546769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.547454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.547743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.548029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.548782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:57.549093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.550506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68653e-0bdf-4aad-b169-f6a5ce0d32c2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.558900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.563963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.563963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.563963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.579585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:57.580792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:57.613891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb10022-71c1-4371-b542-fb23df473b29 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.658135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 38/74] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:57.658316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.658420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.658532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.668795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.669694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.692895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.710200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.762922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3309e5-0406-42e0-ab56-0186d6cb33a9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.769636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd646a-95d1-4668-9cfe-2b5ed8ec6bc2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.796878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.797767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.798053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.798435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.803904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.804785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.805076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.805361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.811195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.812692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.814394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.819067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.820844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.822315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bb21-17df-4514-819d-247f7a7c05ea None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.823998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 38/77] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.825209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9c23-21d6-4b56-b622-1ded40c3139c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.825498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9c23-21d6-4b56-b622-1ded40c3139c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.825777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9c23-21d6-4b56-b622-1ded40c3139c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.827248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 39/78] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:57.829191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e9c23-21d6-4b56-b622-1ded40c3139c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.906910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.916983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851dc00-5c89-43d1-868c-3b885e178964 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.918506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:57.929623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e9c23-21d6-4b56-b622-1ded40c3139c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:57.950195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.951073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.951360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.952186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.953381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:57.954886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:57.956514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 40/79] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:57.957273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:57.962205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:57.962997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:57.963282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:57.963561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:57.974037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:42:57.981684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:42:57.982563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:42:57.983384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 40/80] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:42:57.984016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.061518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efd54-2354-47ec-ac35-d1a0f6f7c22c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.080575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f262-114c-4d15-b865-a4caff2e8d2d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.095374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.096103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.096395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.096676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.113194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.113846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.114159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.114447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.122985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.140586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.169585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.171033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce83c73-77f5-4855-a64e-027cebf092fa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.181279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.182775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.266383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:42:58.267859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.268157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.268444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.282415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:42:58.283254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.284546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:58.285752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:58.323035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.345844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.351048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 42/83] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:42:58.351858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.384270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d77bc-59c7-4787-8e16-029f8ec3d02e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.418090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.418771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.419058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.419341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.448940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2926-9a92-4648-8fc9-37fe84b6bdda None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.481183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.481852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.482160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.482440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.483180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:58.483489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.484679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.484856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.486166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.492564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 43/84] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.493341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.524317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.551664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.584973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 42/85] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:42:58.585807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.591768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a53-c524-4f30-8e9a-5a6660a98a74 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.625412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.626313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.626605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.626887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.628096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.629583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.631332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 44/86] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.632094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.683509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f989-685e-4593-8cae-641cbb1a0e46 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.716479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.717301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.717586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.717860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.719066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.720480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.722183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 43/87] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.722941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.727635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28968b9-4f28-4741-bd9f-e4ccf141f7f5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.732650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.755730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.761958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.762782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.763072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.763354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.764551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.765999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.767744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 45/88] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.768503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.828382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa500d-78c3-49ab-83d2-03171ff2b866 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.861198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.862070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.862383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.862661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.863847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.865276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.866031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb6d7-7ae4-4794-95d3-177a19331d9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.866994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 44/89] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.867752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.903015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:58.903886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.904173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.904448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.905684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:58.907168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:58.908865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 46/90] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:58.908865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:58.944150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:58.969059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf2fc2-fbfe-45b5-8862-30e42a243624 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:58.972899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:59.002100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.003009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.003299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.003580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.004412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:59.004732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.006220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.007404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe3252-0662-4b16-bf63-48c2616f12c6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.014294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 45/91] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:59.015062 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.043354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.044037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.044326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.044609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.045994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:59.046357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.047843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.053999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 47/92] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:42:58 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:59.055181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.168947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35b87a-ab99-44f9-96a7-b06eb6509d70 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.214099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.215172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.215640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.216097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.216993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.219015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae85e1-0045-4258-b2d9-05170a7422e4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.219465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.235170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:59.251020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 46/93] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:42:59 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:59.252399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.254990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:59.262396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.263149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.263439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.263724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.369782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2015-6a0d-4f9b-b4dc-484c82002884 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.413535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.415085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.440025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.441046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.441577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.441955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.443041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=251b3f8442ad41018807bed6ecb8c581) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:59.443540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.445306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.453743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 47/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:42:59 2022] GET /identity/v3/role_assignments?user.id=251b3f8442ad41018807bed6ecb8c581&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:59.542449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 48/95] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:42:59.548397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.620246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:59.670914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bfcbb-0645-49d1-a695-d24f6467cb96 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.712842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.713719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.714010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.714325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] PATH_INFO: `/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.715553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] RBAC: Authorizing `identity:get_project(project_id=eff2792f0c464ccf8f19f88a8b3e4f58)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.717018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8c8c1-49af-4b15-a19e-d9b55cd134c0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.719371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 48/96] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:42:59 2022] GET /identity/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:59.726482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.759549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:42:59.836604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d18c-4473-4843-83a7-ded89424f3d5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.876483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.877164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.877455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.877741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.878685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=eff2792f0c464ccf8f19f88a8b3e4f58, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:59.879005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.880519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a58db-f152-4648-aee1-718ddb673ecf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.886827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:42:59 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=eff2792f0c464ccf8f19f88a8b3e4f58&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:01.627029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd654-7645-4a01-8d47-f9c72b241fe3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:01.628026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd654-7645-4a01-8d47-f9c72b241fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:01.628536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd654-7645-4a01-8d47-f9c72b241fe3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:01.630211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 49/98] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:01.635549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b2f7-19b5-4feb-b15b-08464eae7ee2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:01.636343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b2f7-19b5-4feb-b15b-08464eae7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:01.636817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b2f7-19b5-4feb-b15b-08464eae7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:01.657819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2956b2f7-19b5-4feb-b15b-08464eae7ee2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:01.659337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2956b2f7-19b5-4feb-b15b-08464eae7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:01.735462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:01.758011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd654-7645-4a01-8d47-f9c72b241fe3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:01.822429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396772-082c-4bd1-918d-95f604310928 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:01.823040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396772-082c-4bd1-918d-95f604310928 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:01.823510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396772-082c-4bd1-918d-95f604310928 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:01.825074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 51/100] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:01.833455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:01.834027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:01.834531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:01.853251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:01.854748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:01.874279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:01.941267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 52/101] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:01.965347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:01.966180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd654-7645-4a01-8d47-f9c72b241fe3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.033518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.059366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.060183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.060474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.060755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.080318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6600-1844-4b5e-bf9c-3fbabb3161c7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.099047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:02.114954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:02.115791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:02.116599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:02.120781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.122091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.122542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.122956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.123063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.134648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:02.144487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:02.145319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:02.146066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:02.148964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 53/103] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:02.155592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.174541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.276258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614d69a-9473-461f-ac45-c06d930e7b03 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.316740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.317702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.318186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.318740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.319921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:02.320401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.321944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90847f-6c81-4098-b234-3255ec32cf3d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.332241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 54/104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.333851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491657ae-8208-4ac9-9c96-459a8af19b9d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.338697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491657ae-8208-4ac9-9c96-459a8af19b9d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.338828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491657ae-8208-4ac9-9c96-459a8af19b9d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.340245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 55/105] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:02.341248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491657ae-8208-4ac9-9c96-459a8af19b9d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.415108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9366f-da14-4f7b-997e-4ed9a5a18ef1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.429097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.458585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491657ae-8208-4ac9-9c96-459a8af19b9d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.465618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.466520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.467887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.468323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.469251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:02.469743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.472027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ae3c5-c8ea-4bfe-bc82-f0b70efd9b79 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.482073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 51/106] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.484400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.484900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.485378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.497917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.498955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.499310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.499657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.501349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.503208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70711fb-b8b2-49b1-9a84-2c764f32bd1f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.505214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 56/107] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.506166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:02.507676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:02.510572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322d67-75dc-41f9-8805-6381b1f42f66 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.511832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322d67-75dc-41f9-8805-6381b1f42f66 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.512285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322d67-75dc-41f9-8805-6381b1f42f66 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.516525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 57/108] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:02.517932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322d67-75dc-41f9-8805-6381b1f42f66 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.559230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.586856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 52/109] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:02.587839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.629804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322d67-75dc-41f9-8805-6381b1f42f66 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.666740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.668452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.668938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.669411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.670911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.672617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a10c-d5b0-4584-980e-cc03ea526600 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.674734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 58/110] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.676118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.676608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.677081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.694462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:02.695992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:02.703325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72414efc-10fc-4f4e-8bc0-4f77350b1ae0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.705513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.742649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.743354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.743647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.743925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.745216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.747074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.754429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 53/111] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.755141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.771175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 59/112] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:02.772306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.820566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.876973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e314-f10d-4111-bc50-c3abdf67d509 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.885863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec5cff-ad60-483f-b138-9211625a4d6d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:02.912882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.914192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.914693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.915185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.916866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:02.918582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:02.920668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 60/113] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:02.921615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:02.922852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:02.923758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:02.924141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:02.924526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:02.934876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:02.938239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:02.946676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:02.947589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:02.948367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:02.949130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 54/114] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:02.950547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.027174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34729154-a6b8-44f6-ad25-f918037730c0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.059842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e921b-cd08-478f-906c-6fbb23619ab0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.062636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.063538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.063823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.064106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/46b2b84891824421b912165050c75b4e/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.066361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, user_id=46b2b84891824421b912165050c75b4e, role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.067242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.067822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.081164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 61/115] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:02 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/46b2b84891824421b912165050c75b4e/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:03.081876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.098582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.099411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.099702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.100036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.116181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:03.124999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:03.125898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:03.127126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 55/116] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:03.131451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.172895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.206941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bf5df-daeb-443b-af61-d43acc55561e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.245763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.246702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.246986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.247261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/46b2b84891824421b912165050c75b4e/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.248954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe355b-9149-437e-8d61-bd249dc0cbcb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.249902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, user_id=46b2b84891824421b912165050c75b4e, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.251391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9eb09-1c62-4333-a8f7-f9959badfd5e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.267809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 62/117] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:03 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/46b2b84891824421b912165050c75b4e/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:03.269127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21b3b-f3ee-4713-afd3-56b930145fe4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.269424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21b3b-f3ee-4713-afd3-56b930145fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.269706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc21b3b-f3ee-4713-afd3-56b930145fe4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.271766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 63/118] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:03.273173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a451b-4c70-439b-a132-ae2dd53a76bc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.273490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a451b-4c70-439b-a132-ae2dd53a76bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.273917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a451b-4c70-439b-a132-ae2dd53a76bc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.276321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 64/119] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:03.282187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a451b-4c70-439b-a132-ae2dd53a76bc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.292887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.293902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.294428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.294883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.296390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:03.296893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.298546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bb83e-7066-4173-a554-b5f2d5effb46 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.307951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 56/120] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:03.314145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48cde-f523-4fd6-9139-90794afc9c68 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.314866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48cde-f523-4fd6-9139-90794afc9c68 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.315335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add48cde-f523-4fd6-9139-90794afc9c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.334020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-add48cde-f523-4fd6-9139-90794afc9c68 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:03.335759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-add48cde-f523-4fd6-9139-90794afc9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:03.363455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.417501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 57/121] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:03.419353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.419900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.420939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.429566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a451b-4c70-439b-a132-ae2dd53a76bc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.440469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:03.442248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:03.469384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.476331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.477998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.477998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.477998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.478613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:03.478934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.480675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.490634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 65/122] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:03.491410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.522692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 58/123] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:03.523519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.620179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29853-8c0f-40d7-8039-21567e0f99a0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.634528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.650058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284878d-2cbd-46c2-bbbc-5014a728db50 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.659015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.660001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.660294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.660577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.661845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.663543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.665405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 66/124] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:03.666638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.692573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.693821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.694134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.694546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.707019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:03.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:03.718144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:03.718912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:03.719495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 59/125] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:03.726133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.735527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.786040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ae974-24c8-4de4-aa22-18a03aca0445 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.836005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.837162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.837450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.837793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] PATH_INFO: `/v3/users/50707aacfa3744528e1129a82a354c92` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.838095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2afb7-e96c-4e2e-b7b5-4a26d2aae947 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:03.856115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] RBAC: Authorizing `identity:get_user(user_id=50707aacfa3744528e1129a82a354c92)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.858695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.860828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 67/126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/users/50707aacfa3744528e1129a82a354c92 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:03.861741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.883678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:03.884843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:03.885131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:03.885414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:03.886631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:03.888870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:03.891739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 60/127] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:03.894914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:03.919496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:03.977208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e024da-5acc-4899-a4dd-f790377f94f9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.002456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.013121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.014560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.014849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.015206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.016603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.018065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.020319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 68/128] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:04.021160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.022351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629daeb2-2fe5-4d00-bd84-54f1c078c548 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.064728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.065768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.066060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.066381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.067734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:04.068056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.070150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.082205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 61/129] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:04.083152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.141306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b462-00d3-4a6a-a30b-d5b4e61a8e5a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.170383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.182323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.183409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.183716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.184004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.196213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d436-3693-4188-a278-62246e8639c7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.234134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.235247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.235712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.236168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.237134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.238899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.251977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.268531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.270252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.271107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 62/130] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:43:04 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:04.272086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.399471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d12ab-a78f-4b7d-afe4-bbc0b73aed7c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.436618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.444840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.446140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.447287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.448009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/251b3f8442ad41018807bed6ecb8c581/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.453727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, user_id=251b3f8442ad41018807bed6ecb8c581, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.456040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.459657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 69/131] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:04.460611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.476571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 63/132] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:04 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/251b3f8442ad41018807bed6ecb8c581/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:04.477829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.611800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d868a-2d8c-49c8-8b03-dc2294b2c248 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.638057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.661406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24734b-f8f6-4f18-91cc-56c821209964 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.683889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.684803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.685089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.685368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.687451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.699876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.704069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 64/133] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:04 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:04.709953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.763026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.763968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.764258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.764537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.766530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.768011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:04.769682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 70/134] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:04 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:04.776016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:04.825931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:04.924756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394da520-384c-4f39-a1d8-230ac86d89e5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.987537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca363a0-437c-435a-a00b-c4689749e8a9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:04.990502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:04.991179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:04.991463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:04.991741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:04.992582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=50707aacfa3744528e1129a82a354c92) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:04.992897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:04.994367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:05.006771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 65/135] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:04 2022] GET /identity/v3/role_assignments?user.id=50707aacfa3744528e1129a82a354c92&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:05.035418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:05.036316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:05.036604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:05.036878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] PATH_INFO: `/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:05.038097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] RBAC: Authorizing `identity:get_project(project_id=eff2792f0c464ccf8f19f88a8b3e4f58)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:05.039585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274813ca-0c7c-4e0a-aca2-0476075867ac None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:05.041720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 71/136] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:04 2022] GET /identity/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58 => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:05.048235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:05.309092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348029-09ce-4cb5-b5fe-956b09651f03 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:05.358633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:05.371608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:05.372534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:05.372826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:05.373100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] PATH_INFO: `/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58/users/46b2b84891824421b912165050c75b4e/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:05.375603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] RBAC: Authorizing `identity:create_grant(project_id=eff2792f0c464ccf8f19f88a8b3e4f58, user_id=46b2b84891824421b912165050c75b4e, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:05.376324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b786f1-f936-44ff-86d4-3a21471cec8a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:05.376892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b786f1-f936-44ff-86d4-3a21471cec8a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:05.377064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:05.377556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b786f1-f936-44ff-86d4-3a21471cec8a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:05.379205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 72/137] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:05.388569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:05.389526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:05.389937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:05.397972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 66/138] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:05 2022] PUT /identity/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58/users/46b2b84891824421b912165050c75b4e/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:05.423193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:05.424843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:05.456173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:05.556273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:05.583795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:05.752374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8582-afad-46f4-8e3a-0848c2f6ca86 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:05.812691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:05.814583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:05.815099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:05.815576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:05.856537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:05.867737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:05.868827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:05.869687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:05.875574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:05.884656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.075825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db6aae-c1b6-4a30-9b74-33f02fe57ff4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:06.137190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:06.137876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.138182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.138467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.139262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:06.139573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:06.140964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d06c-6f83-48af-aba4-9660a09b861b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:06.153457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 74/141] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:06.158879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.213438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:06.280621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f6060-f586-45cf-a2b5-f946d09f7df9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:06.300249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d05b-516e-4261-a5b1-02fc61ec173c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.300536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d05b-516e-4261-a5b1-02fc61ec173c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.300810 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d05b-516e-4261-a5b1-02fc61ec173c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.302461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 75/142] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:06.311481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.311763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.312046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.329399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:06.330363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.330737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.330994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.332216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:06.333947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:06.337889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:06.338637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 68/143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:06 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:06.339149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:06.345395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.357123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:06.492042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 76/144] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:06.518827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.593855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766141-9507-444d-98b1-ce886a243b0c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:06.614306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:06.691728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:06.692396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.692689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.692969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.712486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab0e29-bbef-4fc8-a492-7b7d65f3687f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:06.770542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:06.771386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.771672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.771954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.796673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:06.809007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:06.809850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:06.810653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 77/145] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:06.817348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.823869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:06.842482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:06.843979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.018014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24ed89-d96e-4ef5-8398-653c363ea876 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:07.058522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 69/146] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:07.063979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.077838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:07.078553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.078837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.079115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.079980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:07.080295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.081695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.086444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:07.100472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 78/147] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:07.109377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.249050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:07.277904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad261f3-7449-4673-9a1e-c9c31d5e1eab None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:07.345292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ffad2-28ab-440d-b8e0-3a9507774b1a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:07.368207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:07.369084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.369371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.369639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.373527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.375143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.376897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 70/148] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:07.383354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.403743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:07.405388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.405713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.405987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.407282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.408720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.411382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 79/149] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:07.418713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.482495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:07.506758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7164-1e27-450d-b579-fd1cc7af1766 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:07.544814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:07.546034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.546372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.546707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.547869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:07.548204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.549654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845ea73-80b2-495e-a3cf-7fd08566647b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.556564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 71/150] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:07.656253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a255443-21b4-4afb-8aa2-116397a8cd5c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:07.707336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:07.708000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.708284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.708558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.717802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:07.720982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aedac-fd82-4962-ba90-07b381619177 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.721821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aedac-fd82-4962-ba90-07b381619177 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.722270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aedac-fd82-4962-ba90-07b381619177 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.723851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 72/151] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:07.730363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce693f2-fc64-4185-a766-e1cf056148b1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.731088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce693f2-fc64-4185-a766-e1cf056148b1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.731689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce693f2-fc64-4185-a766-e1cf056148b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.761508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dce693f2-fc64-4185-a766-e1cf056148b1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:07.763261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dce693f2-fc64-4185-a766-e1cf056148b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:07.822747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.824009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.856970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 73/152] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:07.859556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e368d3-3090-40bf-acfd-d8f3f89a821e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.860975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e368d3-3090-40bf-acfd-d8f3f89a821e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.861588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e368d3-3090-40bf-acfd-d8f3f89a821e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.863690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 74/153] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:07.871497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:07.871864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:07.872216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:07.890556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:07.891933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:07.939346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 80/154] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:07.940621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.970987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 75/155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:07.971984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:07.983537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:07.986230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.057684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a6b81-8832-456e-af2e-0258f6228915 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.096480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.097707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.098245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.098823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.102236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c6d0a-4778-4dc5-b031-a5f851fa7c2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.110024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:08.120943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:08.122005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 81/156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:08.122882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.143840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.144709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.144990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.145697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.146927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.148372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c6635-1f59-4135-b74f-78afedf11a78 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.150282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 76/157] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:07 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:08.155973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d99f-d121-43ed-93c8-999cdf86048a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.156259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d99f-d121-43ed-93c8-999cdf86048a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.156535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d99f-d121-43ed-93c8-999cdf86048a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.157929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 77/158] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:08.158524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9d99f-d121-43ed-93c8-999cdf86048a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.224183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.231477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d41790-1674-426c-9c5a-1f259dbc2229 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.236006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.267213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.268004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.268283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.268552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.269691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.270481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9d99f-d121-43ed-93c8-999cdf86048a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.271178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.272792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 82/159] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:08.273545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.306957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.307636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.307917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.308193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.308939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:08.309249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.311160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdee70-5b66-404c-8a97-fa6da88069b1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.319398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 78/160] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:08.320850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.321138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.321417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.339114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:08.340914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:08.388098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef236-14b5-4b68-829a-acd6d553f813 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.412148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 79/161] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:08.412785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.431382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.432363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.432768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.433148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.434091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:08.434507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.436597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.450149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 83/162] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:08.450149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.484458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.513975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.558769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67cb7b-8ef7-4d6d-8deb-6b7da4ecb142 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.563747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb4ca-f9d1-49bb-ac8a-0e4788a3fc52 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.597449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.598212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.598944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.598944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.599548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.601377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfc84-3723-47d1-83b0-43e524004b57 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.601479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.601864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.602171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.602452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] PATH_INFO: `/v3/users/251b3f8442ad41018807bed6ecb8c581` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.603660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] RBAC: Authorizing `identity:get_user(user_id=251b3f8442ad41018807bed6ecb8c581)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.605247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.606944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 84/163] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/users/251b3f8442ad41018807bed6ecb8c581 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:08.607490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.626201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 80/164] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:08 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:08.627609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053db6-ce4b-4c8b-9a25-0c549d4a9656 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.627897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053db6-ce4b-4c8b-9a25-0c549d4a9656 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.628410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87053db6-ce4b-4c8b-9a25-0c549d4a9656 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.629724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 81/165] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:08.630486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87053db6-ce4b-4c8b-9a25-0c549d4a9656 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:08.743586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.751013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1773-e375-4b64-af76-a546b8b02cfc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.768235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87053db6-ce4b-4c8b-9a25-0c549d4a9656 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:08.787739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:08.788967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.789629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.789911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.790219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.803199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-97c01859-8e5d-4054-9c40-012ebf4a5721 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:08.810882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:08.811754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:08.813011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 85/166] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:08.813642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.813642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.813854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.817142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:08.817803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:08.818614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:08.818900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:08.835417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:08.836638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:08.899611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:08.901176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:08.920850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 86/167] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:08.921768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.022518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.024358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 82/168] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:09.025271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.048063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.048612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d21a4-b7e4-4649-a3f4-4ff5a40ec504 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.093794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.095284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.095569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.095846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.096601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:09.096912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.098503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.108852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 87/169] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.110426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.156436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b748-02bb-41e2-8178-314d651abeac None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.196229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.197037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.197370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.197650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.209778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:09.218687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:09.219556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:09.220311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 83/170] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:09.220956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.243889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c5ae-3869-4f0e-9515-f0a2d9a4344d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.282281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.283633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.284116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.284628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.286091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.288047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.290010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 88/171] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.291396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.308335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.315403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.340370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79fba9-1da4-44d3-9750-6c4ee0d37d6d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.378262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.379571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.380000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.380520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] PATH_INFO: `/v3/users/50707aacfa3744528e1129a82a354c92` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.381930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] RBAC: Authorizing `identity:get_user(user_id=50707aacfa3744528e1129a82a354c92)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.383764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.385997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 84/172] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/users/50707aacfa3744528e1129a82a354c92 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.387136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.399838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f96a-f5ee-41d0-874b-dcae18d68bd6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.434863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.435603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.436000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.436337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.437075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:09.437383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.438861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.457225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 89/173] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.457225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.520573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9a793-4f6f-45a1-9159-aa78eb6e0966 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.562383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.587081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.587753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.588035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.588309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.589152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=251b3f8442ad41018807bed6ecb8c581) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:09.589466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.592508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.603283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 85/174] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/role_assignments?user.id=251b3f8442ad41018807bed6ecb8c581&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.604116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.607940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35356-eb62-4930-a8ce-0176f9b90ce1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.622555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.698930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.700237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.700725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.701203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.703337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.705008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.706974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 90/175] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.727171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.739259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80ae6-d8c6-4a6b-8df9-bffb1adc456f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.777303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.778225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.778574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.778856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] PATH_INFO: `/v3/users/46b2b84891824421b912165050c75b4e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:09.780246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] RBAC: Authorizing `identity:get_user(user_id=46b2b84891824421b912165050c75b4e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:09.781819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:09.783742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 86/176] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/users/46b2b84891824421b912165050c75b4e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:09.789261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:09.884291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:09.904607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3d96-d9a0-456a-a7fd-ae8c0dab14ec None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:09.942636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:09.943308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:09.943590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:09.943869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:10.018739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:10.020680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:10.044062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2494-d6af-4758-9f2b-23890bf5fff3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:10.108272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:10.109180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:10.109463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:10.109734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/50707aacfa3744528e1129a82a354c92/roles/c76c68a7c19a476190a253a5b9c1946b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:10.114577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:10.118922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, user_id=50707aacfa3744528e1129a82a354c92, role_id=c76c68a7c19a476190a253a5b9c1946b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:10.120385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:10.145026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 87/177] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:10.150574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:10.164530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 91/178] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:09 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/users/50707aacfa3744528e1129a82a354c92/roles/c76c68a7c19a476190a253a5b9c1946b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:10.278457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab56d2-657a-45bb-a98a-2c8f69218fe8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:10.318766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:10.319703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:10.320033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:10.320312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] PATH_INFO: `/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:10.321557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] RBAC: Authorizing `identity:get_project(project_id=eff2792f0c464ccf8f19f88a8b3e4f58)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:10.323181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37b780-40f1-45e5-9185-a6e56642c17b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:10.325000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 88/179] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:10 2022] GET /identity/v3/projects/eff2792f0c464ccf8f19f88a8b3e4f58 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:10.331066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:10.343795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:10.476163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8954-e61b-454b-bd1d-b01fa6601f81 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:10.512662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:10.513683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:10.514225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:10.514722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:10.515747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=eff2792f0c464ccf8f19f88a8b3e4f58, user.id=46b2b84891824421b912165050c75b4e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:10.516258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:10.517902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a3e0-9946-4ca8-a64e-f4e847ece6a9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:10.524062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 92/180] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:10 2022] GET /identity/v3/role_assignments?user.id=46b2b84891824421b912165050c75b4e&scope.project.id=eff2792f0c464ccf8f19f88a8b3e4f58&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:11.285790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3c24-11eb-481a-a1ee-222583385c57 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.286319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3c24-11eb-481a-a1ee-222583385c57 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.286394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3c24-11eb-481a-a1ee-222583385c57 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.287747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 89/181] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:11.293164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf612-23c9-45be-aeab-6936356c881f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.293905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf612-23c9-45be-aeab-6936356c881f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.294348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf612-23c9-45be-aeab-6936356c881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.311811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ccfbf612-23c9-45be-aeab-6936356c881f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:11.313173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ccfbf612-23c9-45be-aeab-6936356c881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:11.375851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.381392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:11.404006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d3c24-11eb-481a-a1ee-222583385c57 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.413296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f2de-2d64-4957-b8ce-f87809716a26 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.413592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f2de-2d64-4957-b8ce-f87809716a26 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.413872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308f2de-2d64-4957-b8ce-f87809716a26 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.415930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 94/183] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:11.421430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d121e-6147-45e5-84e4-9dad5c9fcb4c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.421717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d121e-6147-45e5-84e4-9dad5c9fcb4c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.422052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d121e-6147-45e5-84e4-9dad5c9fcb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.442671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4e1d121e-6147-45e5-84e4-9dad5c9fcb4c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:11.444033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4e1d121e-6147-45e5-84e4-9dad5c9fcb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:11.462501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.525589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d3c24-11eb-481a-a1ee-222583385c57 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:11.534235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 95/184] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:11.541919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbb3e-ab37-47b6-a3e3-fafdee7c6bb4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.542409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbb3e-ab37-47b6-a3e3-fafdee7c6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.542697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbb3e-ab37-47b6-a3e3-fafdee7c6bb4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.544308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 96/185] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:11.549602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.549889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.550191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.567368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:11.568557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:11.569029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:11.569824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.570102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.570520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.582166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:11.589753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:11.590666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:11.591453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 90/186] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:11.596412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.646353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 97/187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:11.647531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.705156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd409381-4d7d-4d68-a997-09c5d1953c22 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:11.709408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.714186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.743920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:11.745045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.745334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.745613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.753475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3ab9-9b4b-4b00-8c17-46bd5b005828 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:11.756189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:11.764415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:11.765354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 91/188] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:11.771439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.796745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:11.797504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.797783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.798053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.798818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:11.799124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:11.800508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:11.808461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 98/189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:11.813601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.881322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6cab-520e-49fd-a2b9-92d30081bd07 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:11.915978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd1c57-f3e0-4887-a064-12992ba57b01 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:11.917576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:11.918392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.918681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.918960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.920670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:11.922145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:11.923939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 92/190] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:11.924533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:11.941627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.956495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:11.957167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.957454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.957745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.958499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:11.958810 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:11.960138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:11.960243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:11.974362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 99/191] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:11.974362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.034388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e70c1-7a65-42f9-8fb7-5f510111d364 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.071265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.072151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.072437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.072833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.076244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808d612-e0dd-437f-91da-412e5205ea81 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.088916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.090415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.092656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 93/192] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:11 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:12.093431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.121134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.121817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.122096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.122400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.123144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.124585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.145966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 100/193] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:11 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:12.147662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.203465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.208876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.215088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84763d2-42ad-4530-a1ec-fa58ea7a4709 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.256821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.257994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.258415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.258789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.260308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.261988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.269306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 94/194] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:12.270571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.291558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a334-42da-4bf8-93e2-c9ab9dc3831a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.339609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.341039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.341474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.342605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.383952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8d8e-de4b-4ecf-91ec-54e00c6b2065 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.425005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.425205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.425663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.425952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.426276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.426707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.461153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.471031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.513011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.515606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a0869-bbb0-46f0-9783-b123ee9bdf16 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.545366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 101/195] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:12.550985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.633735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 95/196] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:12.635166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfd381-5a0c-4920-9fbc-0d8570360321 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.635456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfd381-5a0c-4920-9fbc-0d8570360321 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.635735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfd381-5a0c-4920-9fbc-0d8570360321 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.637009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 96/197] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:12.644252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfd381-5a0c-4920-9fbc-0d8570360321 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.669278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d58b-6dae-4013-ba3c-2e19cb0d574e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.709994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.715567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.716412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.716694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.716995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.718344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.719807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d97c-1c29-45c1-8874-30d6e091dfb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.721876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 102/198] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:12.723101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.723387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.723665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.738602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.744813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:12.747138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:12.766635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfd381-5a0c-4920-9fbc-0d8570360321 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.804429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.805067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.805348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.805620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.806845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.808287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.810055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 97/199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:12.815349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.846291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 103/200] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:12.848404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:12.932961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00c702-3c8c-4112-bf50-431d881f7cac None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.963885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48395-97e1-4e2f-8a91-77d0101e7afa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:12.977638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:12.978267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:12.978554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:12.978833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:12.979671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=4620a35bbf944f2f9d80526a7cf1d19e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:12.979987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:12.982223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:12.990151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 98/201] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/role_assignments?user.id=4620a35bbf944f2f9d80526a7cf1d19e&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:12.990544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:12.995065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:13.019704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:13.020861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:13.021352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:13.021877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:13.023042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=4620a35bbf944f2f9d80526a7cf1d19e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:13.025130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:13.027061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:13.034571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:13.039477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 104/202] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/role_assignments?user.id=4620a35bbf944f2f9d80526a7cf1d19e&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:13.195039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55714-a08a-4dbe-9a39-9f6292c9dae3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:13.237857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:13.238631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:13.238914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:13.239188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:13.251807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:13.259673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:13.260641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:13.261417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 99/203] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:13.267073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:13.401666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4c9f-2082-418b-b6f7-c2ea9370b49c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:13.438623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:13.439298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:13.439580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:13.439856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:13.440607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:13.440912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:13.442320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:13.450841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 105/204] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:13.456423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:13.553014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:13.610321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed300-7fea-4a86-a6df-561eab74888b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:13.645189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:13.646083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:13.646402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:13.646681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] PATH_INFO: `/v3/users/50707aacfa3744528e1129a82a354c92` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:13.647891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] RBAC: Authorizing `identity:get_user(user_id=50707aacfa3744528e1129a82a354c92)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:13.649329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:13.650997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 100/205] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:13 2022] GET /identity/v3/users/50707aacfa3744528e1129a82a354c92 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:13.661144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:13.743383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:13.793901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39e9a7-d46b-41f2-8154-8298e55c0f91 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:13.835359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:13.835950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:13.836235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:13.836510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:13.912937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:13.914426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:13.974622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:14.032522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:14.038219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:14.140742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a8f4e-22db-4272-a249-cffc009d9344 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:14.174572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:14.175437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.175722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.176000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.177186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:14.178663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe2f0-27c2-4008-9642-0fc3324ac2a6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:14.180546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 101/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:14 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:14.182440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:14.186857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:14.323644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d66741-9d47-41c9-a8ca-6e557013bcb3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:14.369634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:14.370667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.371172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.371644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.372729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9, user.id=50707aacfa3744528e1129a82a354c92) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:14.373808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:14.375546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c3f12-c0e6-4de7-b99f-3bb226c92673 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:14.382130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 107/208] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:14 2022] GET /identity/v3/role_assignments?user.id=50707aacfa3744528e1129a82a354c92&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:14.723898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e11f-8753-4f48-ab7f-72d8b6fcf0fe None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.724379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e11f-8753-4f48-ab7f-72d8b6fcf0fe None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.724379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e11f-8753-4f48-ab7f-72d8b6fcf0fe None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.725985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 102/209] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:14.731098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32b19-9a43-4ea4-8b12-9a3a084b5340 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.731498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32b19-9a43-4ea4-8b12-9a3a084b5340 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.731665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32b19-9a43-4ea4-8b12-9a3a084b5340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.749379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-39a32b19-9a43-4ea4-8b12-9a3a084b5340 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:14.750603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-39a32b19-9a43-4ea4-8b12-9a3a084b5340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:14.771127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:14.820038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:14.844811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9e11f-8753-4f48-ab7f-72d8b6fcf0fe None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:14.948873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9e11f-8753-4f48-ab7f-72d8b6fcf0fe None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:14.983671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:14.984363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.984642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.984911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.995597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:15.003359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:15.004221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:15.005015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 103/211] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:15.009648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275f34-34d2-466e-bc25-dd271273bc92 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.009943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275f34-34d2-466e-bc25-dd271273bc92 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.010244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275f34-34d2-466e-bc25-dd271273bc92 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.011853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 109/212] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:15.012466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.017838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.018150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.018431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.038610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:15.040347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:15.070097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.134333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 110/213] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:15.140298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3e0a-a907-4133-91c8-8abdbc6cac10 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.156057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.175079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.175752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.176150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.176429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.177176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:15.177478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.178875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.188259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 104/214] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:15.193417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.257174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.275282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563db15-547a-443e-98c5-d3ae9f0437a5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.296438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d9ad4-8b30-4037-bfab-2bc931f5d54a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.306755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.315664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.316723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.317305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.317781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.319213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.321110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.328258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 111/215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:15.329438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.331812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.332803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.333011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.333221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] PATH_INFO: `/v3/users/84a82213ee9e41b484753f1a7aa8474c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.348328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] RBAC: Authorizing `identity:get_user(user_id=84a82213ee9e41b484753f1a7aa8474c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.349809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.355933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 105/216] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/users/84a82213ee9e41b484753f1a7aa8474c => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:15.356936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.458041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4558-da0c-4972-8ed1-3e100343c54a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.487047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935a84b-26e6-4f66-a3a5-9b7d9c6af7fc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.500169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.500938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.501228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.501505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.502256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.503692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff615a-151b-4725-8ed8-1ca498312b68 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.526136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.526786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 112/217] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:15 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:15.526958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.527204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.527481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.535726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5308-e552-445e-8c93-93e191ed45fb None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.536082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5308-e552-445e-8c93-93e191ed45fb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.536296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5308-e552-445e-8c93-93e191ed45fb None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.538844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 113/218] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:15.545264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfba5f-ba9e-4f22-a88e-2312fa5746e0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.545635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfba5f-ba9e-4f22-a88e-2312fa5746e0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.545824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfba5f-ba9e-4f22-a88e-2312fa5746e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.567784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-55dfba5f-ba9e-4f22-a88e-2312fa5746e0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:15.569037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-55dfba5f-ba9e-4f22-a88e-2312fa5746e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:15.574553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.590485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.629260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.630778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.650674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 114/219] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:15.652417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8021b-4ee0-49c8-9c96-d552d45caaf3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.652889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8021b-4ee0-49c8-9c96-d552d45caaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.653341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8021b-4ee0-49c8-9c96-d552d45caaf3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.655249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 115/220] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:15.661142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.662516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.662877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.682375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:15.683567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:15.761643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 106/221] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:15.761643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.762242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 116/222] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:15.764276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.857271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.863707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:15.898999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8afb1-c519-4392-9a3f-884ef6af069c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.911235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4862-bf1a-40d2-b4d2-c7a44253127d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:15.936131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.937269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.937724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.938168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.939511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:15.941096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:15.943188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 117/223] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:15.944231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:15.951585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:15.952536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.952922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.953308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.964194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:15.972237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:15.973312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:15.974280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:15.976419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 107/224] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:15.977334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.059532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821022-356d-43a9-b6d4-722d5601f143 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.082954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc0b2-3f72-4f7e-8834-8b2107038169 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.097171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.098303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.098728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.099166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.106857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:16.112024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:16.112386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:16.123050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:16.124597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:16.125553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:16.126296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 118/225] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:16.126545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.146203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.146203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.146203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.146203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.146626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=84a82213ee9e41b484753f1a7aa8474c) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:16.146707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.148156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.154180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 108/226] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:15 2022] GET /identity/v3/role_assignments?user.id=84a82213ee9e41b484753f1a7aa8474c&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.155255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.329239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf5f62-7859-45a3-b7d1-0a62b7e6bdfd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.371499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.371748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53495ba1-545e-4470-83fa-4f1d39fe4f4b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.372096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.372424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.372704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.373661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:16.373971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.375394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.385403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 119/227] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.391032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.458736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:16.491372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.492062 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.492348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.492623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.493373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:16.493677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.495084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.498686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad13b6e-3be1-493b-901e-72c88045fc6d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.524090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 109/228] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.530164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.541348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.542347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.542675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.542952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.544613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.546790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.552118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 120/229] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.560730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.645121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:16.711027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990303c6-9c7c-4a8f-a981-9d4517d03b2f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.723731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3884e-95ad-4c12-b611-36f6d48c313e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.746475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:16.754271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.755155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.755438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.755717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.758377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.759818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.766559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 121/230] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.773919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.834832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.836438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.836946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.837420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.842620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.844383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.846329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 110/231] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:16.855056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:16.890068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a58-cb3f-4a9d-9897-84607e0360a6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:16.928415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:16.929358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:16.929647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:16.929919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/4620a35bbf944f2f9d80526a7cf1d19e/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:16.932033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, user_id=4620a35bbf944f2f9d80526a7cf1d19e, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:16.933821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:16.947706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 122/232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:16 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/4620a35bbf944f2f9d80526a7cf1d19e/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:17.079397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8280ffe-6b09-4044-9e20-d76a14aa5f9b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:17.110993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:17.130965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:17.131873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:17.132156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:17.132431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:17.139506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:17.140978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca234-5842-4ab7-b141-dd7bbfd8982c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:17.142807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 111/233] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:16 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:17.148713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:17.212429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:17.264558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13c8e-d7df-4ae9-a1cb-d68e5a1745a0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:17.300113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:17.301005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:17.301285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:17.301558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/4620a35bbf944f2f9d80526a7cf1d19e/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:17.303816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, user_id=4620a35bbf944f2f9d80526a7cf1d19e, role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:17.305253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0182c66-151e-4fff-abb6-85c072fafac0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:17.333735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 123/234] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:17 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/4620a35bbf944f2f9d80526a7cf1d19e/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:17.894281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a912b4-248f-4045-a2fa-5bf606dfb055 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:17.894824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a912b4-248f-4045-a2fa-5bf606dfb055 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:17.894824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a912b4-248f-4045-a2fa-5bf606dfb055 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:17.896201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 112/235] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:17.901564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165141e-0364-4ef2-871f-081c5aa25fa1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:17.901968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165141e-0364-4ef2-871f-081c5aa25fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:17.902162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165141e-0364-4ef2-871f-081c5aa25fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:17.927346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6165141e-0364-4ef2-871f-081c5aa25fa1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:17.928904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6165141e-0364-4ef2-871f-081c5aa25fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:18.024790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 124/236] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:18.055072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b2-0d25-4c3d-972a-560bde268a00 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.055389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b2-0d25-4c3d-972a-560bde268a00 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.055636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b2-0d25-4c3d-972a-560bde268a00 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.057008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 113/237] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:18.062200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.062511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.062790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.076182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0469b2-0d25-4c3d-972a-560bde268a00 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.079582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:18.080763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:18.135752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:18.163137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 125/238] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:18.190990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.297956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e7129-0028-488a-a057-1f59575ed4c7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.336665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0469b2-0d25-4c3d-972a-560bde268a00 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.339722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.340532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.340811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.341084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.346801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:18.348245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:18.349875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 126/239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:18.359096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.411489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.412298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.412579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.412851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.439244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:18.447709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:18.448587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:18.449641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 114/240] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:18.459207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.462564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:18.517695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:18.563613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc2f33-c3c9-42e7-a9d3-735e45553f07 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.575897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecab78-1d5a-4878-aa2b-59294c456ecd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.604788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.605461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.605742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.606330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.607169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:18.608957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:18.617303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.618635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.619466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.620276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.621471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:18.622171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:18.624596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9a51-13e0-4f04-9309-92732b9ddb5f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:18.633372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 127/241] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:18 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:18.633501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 115/242] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:18.638187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c88cf-1db3-4377-ad10-9e8a9ab5b534 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.638187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c88cf-1db3-4377-ad10-9e8a9ab5b534 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.638187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c88cf-1db3-4377-ad10-9e8a9ab5b534 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.638187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 116/243] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:18.640332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.643012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.643302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.643580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.669193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:18.671183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:18.755643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 117/244] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:18.794082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.846830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:18.853296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021471cc-9ac4-41fb-b5ad-a121dc9157b3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.877866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:18.910798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.911695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.911985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.912296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] PATH_INFO: `/v3/users/e7025a2a59f640419425347e48cd105d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.927613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] RBAC: Authorizing `identity:get_user(user_id=e7025a2a59f640419425347e48cd105d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:18.930180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:18.932332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 128/245] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/users/e7025a2a59f640419425347e48cd105d => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:18.940983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:18.945065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac916f56-6546-4aaf-8eed-d1dc3631a04a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:18.981591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:18.982952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:18.983249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:18.983511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:18.995012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:19.003169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:19.004070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:19.005106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 118/246] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:19.010364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.083184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f73f2-958c-4410-9807-7ae99c3c6cbb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.135458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.136372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.137104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.137942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.143574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59b32d-34ee-4eb0-9d84-08a80e3cd986 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.145188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.173481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.182191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.183038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.183434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.183806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.185109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:19.185109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.187139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.196717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 119/247] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:19.203253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.228447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.230178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393857c-8ef7-45fa-b7a5-4e9e6a722ebb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.336934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4feee-421b-4152-bcbb-d2c270af6452 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.356487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 129/248] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:19.357366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52fa8-7fa9-45a7-9027-481d842fc598 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.358304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52fa8-7fa9-45a7-9027-481d842fc598 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.358469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e52fa8-7fa9-45a7-9027-481d842fc598 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.360042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 130/249] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:19.365618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.370043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.370043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.387422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.388708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:19.388819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.389283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.389747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] PATH_INFO: `/v3/users/84a82213ee9e41b484753f1a7aa8474c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.389922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:19.391360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] RBAC: Authorizing `identity:get_user(user_id=84a82213ee9e41b484753f1a7aa8474c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.393207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.400933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 120/250] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/users/84a82213ee9e41b484753f1a7aa8474c => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:19.402698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.446565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.474896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.494036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 131/251] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:19.496149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.533914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa764b5-342d-4d77-be3e-5b19d15472c1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.575508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.576716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.577223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.577689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.579350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.580980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.583038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 121/252] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:19.584182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.610699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40fcec-16db-427e-93fa-c586d285d685 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.645251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.646146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.646435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.646804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.648071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.649367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.651275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 132/253] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:19.656954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.694057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.698034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183363-ae7e-4a23-aff4-5b2c58dfb3b8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.714666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:19.739646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.740943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.741528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.742045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.755811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:19.759881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b132df-001a-4ef1-aacf-b87aeb6365cb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:19.768402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:19.769317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:19.770075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:19.773634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 122/254] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:19.778442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.819947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:19.820670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:19.820953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:19.821231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:19.822795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=e7025a2a59f640419425347e48cd105d) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:19.823110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:19.824556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:19.838249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 133/255] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/role_assignments?user.id=e7025a2a59f640419425347e48cd105d&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:19.839196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:19.976235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f318-cba0-4ede-8592-abed2cc14a83 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.023397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6f3fe-272f-495f-be60-e8197f0e70ef None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.041886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.042878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.043169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.043444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/84a82213ee9e41b484753f1a7aa8474c/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.045534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, user_id=84a82213ee9e41b484753f1a7aa8474c, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.047055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db8fe-d2c8-49de-b28d-704db353c21e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.062162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.073134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 123/256] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:19 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/84a82213ee9e41b484753f1a7aa8474c/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:20.085171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.086306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.086826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.087323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.088283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:20.090726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.092196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dd0c-d116-48f9-b68e-c6227c38a422 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.092498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dd0c-d116-48f9-b68e-c6227c38a422 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.092785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dd0c-d116-48f9-b68e-c6227c38a422 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.093165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.094278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 124/257] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:20.107408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 134/258] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:20.109911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.114140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.114140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.115645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.143143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:20.144425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:20.196117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.226223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ffa5-fe2c-4400-baa1-e659f83a83e3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.263046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.264900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.265387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.265870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.267342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.269083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.271479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 135/259] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:20.279235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.332813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 125/260] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:20.350486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.391203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.401760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03677ee-1456-4ade-8564-765b73345474 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.439041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.439860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.440244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.440621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.509657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.511822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.563948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.618583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 136/261] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:20.620047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff32d73-ad63-44d8-a6df-9bc2fc3a357c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.628043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.719750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.720584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.720870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.721147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.735359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a558d0-4188-42df-9007-bb7fb92a8ff8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.735867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:20.752681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:20.753707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:20.754525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 126/262] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:20.760006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.776390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.777586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.778087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.778598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.780557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.782334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.783080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.785497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 137/263] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:20.791228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:20.822612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:20.920880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2096a-b445-48d5-a127-e7b038bd5520 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.955067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:20.955706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9627ba-391a-4a17-9c23-66feff0da688 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:20.955844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:20.956045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:20.956328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:20.957101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:20.957412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:20.960529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:20.974649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 127/264] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:20.974649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:21.028530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:21.029751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.030008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.030319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:21.031157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=4620a35bbf944f2f9d80526a7cf1d19e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:21.031472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:21.032923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:21.051242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 138/265] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/role_assignments?user.id=4620a35bbf944f2f9d80526a7cf1d19e&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:21.094609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:21.126369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222133-d258-46d9-b00b-1bb820e93164 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:21.176544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:21.177465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.177751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.178031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] PATH_INFO: `/v3/users/4620a35bbf944f2f9d80526a7cf1d19e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:21.179334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=4620a35bbf944f2f9d80526a7cf1d19e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:21.180803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:21.182840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 128/266] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:20 2022] GET /identity/v3/users/4620a35bbf944f2f9d80526a7cf1d19e => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:21.187962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:21.275688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:21.299882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f917f3-fe6f-41c8-8435-d71041c3460b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:21.349451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:21.350509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.350996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.351467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:21.431940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:21.433764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:21.543163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:21.564176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 139/267] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:21.569791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:21.697856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8925f-44e6-4650-a60d-4330a348a3a8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:21.739569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:21.740467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.740755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.741037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:21.742375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:21.743870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07866a-fad7-4923-8748-1504a8c4f448 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:21.745676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 129/268] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:21 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:21.752013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:21.899318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46ce9-d6a0-4693-9221-eab64d09f65f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:21.946985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:21.947655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.947995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.948275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:21.949108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=4620a35bbf944f2f9d80526a7cf1d19e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:21.949471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:21.950971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579982-1240-41c4-b914-9e15c9496b74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:21.962726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 140/269] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:21 2022] GET /identity/v3/role_assignments?user.id=4620a35bbf944f2f9d80526a7cf1d19e&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:21.997046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b63a-5fd5-4dfa-b60e-1ac4dd67c182 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:21.997427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b63a-5fd5-4dfa-b60e-1ac4dd67c182 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:21.997783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b63a-5fd5-4dfa-b60e-1ac4dd67c182 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.000191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 130/270] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:22.006318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.006911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.007372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.034136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:22.036095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:22.096164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.133491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 141/271] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:22.156690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b63a-5fd5-4dfa-b60e-1ac4dd67c182 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.168636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.272272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b63a-5fd5-4dfa-b60e-1ac4dd67c182 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.311070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.311935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.312220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.312491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.325238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f9e65001-6111-47eb-8645-d3d0bc605b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:22.333446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:22.334333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:22.335111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 131/272] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:22.340604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.394830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b70d-f25a-4072-a4aa-dbcea5e3f4f5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.395133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b70d-f25a-4072-a4aa-dbcea5e3f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.395374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b70d-f25a-4072-a4aa-dbcea5e3f4f5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.396992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 132/273] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:22.411678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.411985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.412258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.437581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:22.438858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:22.468411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69117-1d97-43d8-8f42-c98d4098a79d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.510236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.510932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.511215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.511493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.512239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:22.512541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:22.513942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:22.518801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.523371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 142/274] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:22.525616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 133/275] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:22.529875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.552243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.575669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.637504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d7ff-497a-46e3-85b7-2b71f6f47e39 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.655890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ae86c-ea28-44e4-afbe-5598fd2d081c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.675029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.676079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.676471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.676854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] PATH_INFO: `/v3/users/dff65811f3414562984dace6377d47e6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.693558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] RBAC: Authorizing `identity:get_user(user_id=dff65811f3414562984dace6377d47e6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:22.695299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:22.697490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 143/276] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:22 2022] GET /identity/v3/users/dff65811f3414562984dace6377d47e6 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:22.699133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.699931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.700217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.700493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.702333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:22.703287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.703795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:22.705637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 134/277] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:22.710911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:22.785503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.818527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:22.825415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61cfc8-b55c-4547-8137-78e5306d2241 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.837271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68970b0-b950-4347-a58a-03782ea09592 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:22.861967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.862756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.863037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.863316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.864139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, user.id=dff65811f3414562984dace6377d47e6, scope.system=all) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:22.864449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:22.866097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3033-03b1-462e-b361-39696fb61191 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:22.874165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 144/278] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jul 13 08:43:22 2022] GET /identity/v3/role_assignments?user.id=dff65811f3414562984dace6377d47e6&scope.system=all&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:22.874165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dd6d-d15b-451a-a382-64c2ebbd5e6c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.874165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dd6d-d15b-451a-a382-64c2ebbd5e6c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.874165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dd6d-d15b-451a-a382-64c2ebbd5e6c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.874944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 145/279] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:22.876022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:22.876719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.877005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.877281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.878014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:22.879544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435c86f-17e3-4f44-bd6d-e6e049bf4805 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:22.888040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.889209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.889663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.906162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 135/280] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:22 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:22.915292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:22.918453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:22.918879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea761-4829-4f42-9136-6fd39fbc99f0 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.919370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea761-4829-4f42-9136-6fd39fbc99f0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.919834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea761-4829-4f42-9136-6fd39fbc99f0 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.922036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 136/281] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:22.928461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:22.929137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:22.929659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:22.949182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:22.951434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:23.017220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 146/282] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:23.039949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.044624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 137/283] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:23.069101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.139070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.168824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.183850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634e46-d007-46f8-b9cc-2e11ac2ddb31 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.196018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae2e1-5b7e-4b5d-909b-621f8814381c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.223787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.224963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.225443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.225945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.242673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:23.251577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:23.252461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:23.253214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:23.253785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.253785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.253785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.253982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.255740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 147/284] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:23.261246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.268481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:23.277241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:23.278176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:23.278969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:23.280705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 138/285] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:23.287978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.398094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76ecc-038a-4d41-b64c-5760f191ecc1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.416645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a7232-bb87-4b18-b01b-ece621d98d45 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.429694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.436592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.437556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.438092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.438615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.439545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:23.440041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:23.441808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:23.451663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 148/286] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:23.454809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.455762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.456257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.456735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.457674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:23.457793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.458418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:23.459992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:23.470977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 139/287] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:23.482996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.483776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.573795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f4c7-28d6-4b28-a65c-7fe47b8500ff None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.612125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.613001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.613277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.613548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] PATH_INFO: `/v3/users/e7025a2a59f640419425347e48cd105d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.614966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] RBAC: Authorizing `identity:get_user(user_id=e7025a2a59f640419425347e48cd105d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:23.616836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:23.618667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 149/288] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/users/e7025a2a59f640419425347e48cd105d => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:23.630141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.710153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56f9b8-4b75-459d-b2b3-c0e201d7bc0a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.773003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.773876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.774175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.774456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] PATH_INFO: `/v3/users/84a82213ee9e41b484753f1a7aa8474c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.777181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] RBAC: Authorizing `identity:get_user(user_id=84a82213ee9e41b484753f1a7aa8474c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:23.777838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.780181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:23.783408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 140/289] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/users/84a82213ee9e41b484753f1a7aa8474c => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:23.790743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.814767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48585b2-bba4-4037-bb20-caa7bdca101b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:23.852145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:23.853246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:23.853668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:23.854132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:23.859051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:23.862560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:23.866795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 150/290] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:23.877422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:23.889405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:23.995197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f9f0-cd8f-471b-b763-0dae75555438 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:24.010679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d611-f634-497c-8eaa-57581b5fdbf3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:24.045324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:24.046308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:24.046930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:24.047209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:24.047553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:24.047828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/e7025a2a59f640419425347e48cd105d/roles/c76c68a7c19a476190a253a5b9c1946b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:24.048064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:24.048533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:24.050065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, user_id=e7025a2a59f640419425347e48cd105d, role_id=c76c68a7c19a476190a253a5b9c1946b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:24.051570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:24.085326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 151/291] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:23 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/users/e7025a2a59f640419425347e48cd105d/roles/c76c68a7c19a476190a253a5b9c1946b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:24.131532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:24.133257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:24.178816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:24.241634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 141/292] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:24.247136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:24.269881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:24.383648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334a546-0826-44c8-b240-54dc1e5f84af None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:24.420557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:24.421424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:24.421703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:24.421976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:24.423220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:24.424650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8273f0-294e-43af-b538-98d9544b2f31 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:24.426681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 152/293] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:24 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:24.432247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:24.571746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d3f70-163a-4f37-8f07-975c9d39b34b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:24.618808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:24.619842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:24.620338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:24.620807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:24.621815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=84a82213ee9e41b484753f1a7aa8474c) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:24.622339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:24.624012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877908a-d58e-4ec9-a165-d1b0a216a17a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:24.634667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 142/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:24 2022] GET /identity/v3/role_assignments?user.id=84a82213ee9e41b484753f1a7aa8474c&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:25.178002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675ca4-b14b-4b43-9481-ce11ad1ff344 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.178574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675ca4-b14b-4b43-9481-ce11ad1ff344 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.178574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675ca4-b14b-4b43-9481-ce11ad1ff344 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.180116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 153/295] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:25.186036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.186357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.186631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.200492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.207461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:25.208780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:25.282750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 143/296] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:25.304637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c675ca4-b14b-4b43-9481-ce11ad1ff344 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.385930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.414424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c675ca4-b14b-4b43-9481-ce11ad1ff344 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:25.450522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:25.452383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.452813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.453230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.465115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8bfd7a93-f52e-4ef9-86a4-fb8b41642e72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:25.473602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:25.475309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:25.476297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:25.478293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 154/297] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:25.486152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.494302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39f4e-2841-4b05-be22-77406a8f31ce None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.494594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39f4e-2841-4b05-be22-77406a8f31ce None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.494874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39f4e-2841-4b05-be22-77406a8f31ce None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.496251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 155/298] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:25.501881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.502203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.502489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.521019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:25.522580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:25.602408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 156/299] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:25.619622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f730d-fca3-4b58-a0ec-7cfd9be2dc43 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:25.622123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.665132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:25.665727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.666862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.666862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.667315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:25.667620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:25.669160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:25.672506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.681516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 144/300] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:25.687939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.699125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.736975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430cd80-df0e-4e82-b1bc-3c270eeb26b6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:25.771742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:25.772540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.772822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.773186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.774288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:25.775722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a0147-a7ac-4007-954f-9ff62a0be473 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:25.779254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 157/301] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:25.781168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0634b8-2220-427c-9bbe-68c1ff17ad3a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.781859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0634b8-2220-427c-9bbe-68c1ff17ad3a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.782359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0634b8-2220-427c-9bbe-68c1ff17ad3a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.784286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 158/302] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:25.785932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0634b8-2220-427c-9bbe-68c1ff17ad3a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.804187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4447-b56c-4eff-98f9-8c96ba04d656 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:25.848480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:25.849621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.850172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.850456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] PATH_INFO: `/v3/users/dff65811f3414562984dace6377d47e6` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.852330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=dff65811f3414562984dace6377d47e6)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:25.853803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53358c24-1c77-4b2f-a6e2-a593a221c5a5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:25.861371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 145/303] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:25 2022] GET /identity/v3/users/dff65811f3414562984dace6377d47e6 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:25.861371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.861371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.861371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.880287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:25.881729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:25.891370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0634b8-2220-427c-9bbe-68c1ff17ad3a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:25.930490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:25.931088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:25.931368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:25.931644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] PATH_INFO: `/v3/groups` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:25.932324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:25.933750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:25.937166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.946612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:25.962054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 159/304] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Jul 13 08:43:25 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:25.962054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:25.964437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 146/305] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:25.989399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.080199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f930f-565b-492d-9ad7-3eb626d1adc0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.129221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ac88e-4679-4ff0-99e0-30a93b89437c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.138524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.139416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.139697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.139974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] PATH_INFO: `/v3/system/users/dff65811f3414562984dace6377d47e6/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.142953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dff65811f3414562984dace6377d47e6, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:26.144279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:26.156568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 160/306] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jul 13 08:43:25 2022] PUT /identity/v3/system/users/dff65811f3414562984dace6377d47e6/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:26.172022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.172840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.173122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.173398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.191458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:26.199431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:26.200383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:26.201722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:26.204168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 147/307] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:26.207719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.272025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:26.326798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070ef22-e8b3-4e74-baba-c6f5ec9a8fdd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.362126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.362803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.363086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.363356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.364097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:26.364400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:26.365823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1edc4-e2bd-46ed-a8cc-c4067885ed5d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:26.375537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 161/308] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:26.380907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.438489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:26.469530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930639-2995-47bf-bbfb-80b2873c4666 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.469806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930639-2995-47bf-bbfb-80b2873c4666 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.469987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930639-2995-47bf-bbfb-80b2873c4666 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.471696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 162/309] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:26.476630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.476923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.477211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.486197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66a35b-bd60-4945-a478-0cc4e0a92ffd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.496387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:26.498816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:26.521567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.522536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.522822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.523105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] PATH_INFO: `/v3/users/d4f741507d2b48f6a580c928ba000795` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.540034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] RBAC: Authorizing `identity:get_user(user_id=d4f741507d2b48f6a580c928ba000795)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:26.542922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:26.545504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 148/310] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/users/d4f741507d2b48f6a580c928ba000795 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:26.551201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.586507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 163/311] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:26.609169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.659597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:26.683896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee850-545b-4d7d-84bb-4f6b45a94e8a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.700680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:26.719761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab65cf-31be-445a-88a9-28c21c646a88 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.727350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.728683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.729202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.730055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.731100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, user.id=d4f741507d2b48f6a580c928ba000795, scope.system=all) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:26.731894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:26.734559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:26.742200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 149/312] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/role_assignments?user.id=d4f741507d2b48f6a580c928ba000795&scope.system=all&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:26.763771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.765614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.766313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.766793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.780525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:26.789076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:26.790036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:26.790864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:26.793339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 164/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:26.800177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:26.914256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378193-5774-451a-a2c6-bf3133bc8334 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:26.949551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:26.950490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:26.950953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:26.951402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:26.952290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:26.952741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:26.954274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:26.962898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 150/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:26.971683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:27.073683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c12d-dd1e-45ec-841b-a2ff8c799a72 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:27.084248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:27.109975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:27.110946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.111236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.111523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] PATH_INFO: `/v3/users/e7025a2a59f640419425347e48cd105d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.112739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] RBAC: Authorizing `identity:get_user(user_id=e7025a2a59f640419425347e48cd105d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:27.114419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:27.116061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 165/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:26 2022] GET /identity/v3/users/e7025a2a59f640419425347e48cd105d => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:27.121525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:27.165508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:27.229329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782dc6e-9d00-4394-93c3-ffcf18fbb954 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:27.266024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:27.266834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.267129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.267408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.337629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:27.339118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:27.382614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:27.442896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 151/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:27.447997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:27.555208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bc611-1979-4faf-a1ab-95da62a0a13d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:27.589758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:27.590944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.591472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.591969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.593353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:27.595005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536acf9f-e60a-48e2-8e9b-43dae11bdadf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:27.597218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 166/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:27 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:27.602682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:27.702374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2cb2a-2f37-47f1-8790-a2f1738193f5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:27.736598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:27.737261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.737549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.737824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.738686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, scope.project.id=9fb50551187b49a29f80c36bb2fed27c, user.id=e7025a2a59f640419425347e48cd105d) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:27.738995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:27.740427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09236-1ea7-4ef5-a2d7-6c9ef6baa71f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:27.746776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 152/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:27 2022] GET /identity/v3/role_assignments?user.id=e7025a2a59f640419425347e48cd105d&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:28.172985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827ed4-38b9-4242-a159-ca5158882ace None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.173291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827ed4-38b9-4242-a159-ca5158882ace None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.173561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66827ed4-38b9-4242-a159-ca5158882ace None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.175108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 167/319] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:28.180096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a676f-6ec9-4513-b5d1-8d9baca0bede None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.180391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a676f-6ec9-4513-b5d1-8d9baca0bede None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.180668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a676f-6ec9-4513-b5d1-8d9baca0bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.187296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:28.198411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-409a676f-6ec9-4513-b5d1-8d9baca0bede None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:28.199601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-409a676f-6ec9-4513-b5d1-8d9baca0bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:28.267311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 153/320] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:28.289529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66827ed4-38b9-4242-a159-ca5158882ace None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.316684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551ee6-5600-4139-841f-7b1920ff830c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.316974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551ee6-5600-4139-841f-7b1920ff830c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.317244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551ee6-5600-4139-841f-7b1920ff830c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.318812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 154/321] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:28.323960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.324547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.324949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.340755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:28.345697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:28.346909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:28.395784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66827ed4-38b9-4242-a159-ca5158882ace None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:28.434153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 155/322] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:28.434672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:28.434672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.434672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.434672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.434957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:28.435126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:28.436888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 168/323] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:28.442241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.452724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.509556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:28.551972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e8d83-6d4a-47b1-b0e2-3781fc9f3c91 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:28.555295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802ea2-37a1-4fa7-b5af-7ea4bea093e9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:28.569356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:28.588027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:28.588902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.589187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.589466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] PATH_INFO: `/v3/groups` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.590195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:28.592004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:28.592226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:28.592796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.593079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.593354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.604643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:28.608869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 156/324] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Jul 13 08:43:28 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-777351e0-8177-495c-868c-f10fb3bb4eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:28.613601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:28.614696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:28.615487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 169/325] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:28.624465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.735761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7797-3f03-4858-8827-b798a772c5fe None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:28.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:28.775612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:28.776503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.776789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.777090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.777847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:28.778173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:28.780172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:28.789308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 157/326] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:28.789639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53038-4e1f-478b-9a2c-c45e711e8ab3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.789930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53038-4e1f-478b-9a2c-c45e711e8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.790236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53038-4e1f-478b-9a2c-c45e711e8ab3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.791861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 170/327] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:28.796668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.797228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.797522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.797802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.816793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:28.818357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:28.905661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 171/328] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:28.915146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a04f-fa35-4b18-ade6-366efc6629ac None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:28.927301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:28.961052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:28.961876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:28.962211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:28.962492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] PATH_INFO: `/v3/users/dff65811f3414562984dace6377d47e6` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:28.963697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] RBAC: Authorizing `identity:get_user(user_id=dff65811f3414562984dace6377d47e6)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:28.965120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:28.971089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 158/329] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/users/dff65811f3414562984dace6377d47e6 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:28.976242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:29.043189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:29.055779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec34219-8d03-4777-b7b7-389ba9e13d4d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:29.059495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:29.104637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2caa2-3c0e-4bff-bea6-c6c86ef29f7a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:29.116432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:29.117566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:29.118082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:29.119070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:29.140169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:29.151463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:29.152339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:29.153127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:29.154239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:29.154618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:29.154902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:29.155173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:29.156001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] RBAC: Adding query filter params (role.id=4df88e7f9eda45a4921f67b10624be9e, user.id=dff65811f3414562984dace6377d47e6, scope.system=all) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:29.156309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:29.157050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 172/330] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:29.159274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:29.163414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:29.174585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 159/331] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jul 13 08:43:28 2022] GET /identity/v3/role_assignments?user.id=dff65811f3414562984dace6377d47e6&scope.system=all&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:29.297998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b39e-6e4a-49d8-94d2-0c7474939ef8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:29.337935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:29.339029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:29.339512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:29.340001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:29.340939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:29.341497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:29.343283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:29.356997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 173/332] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:29.362840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:29.481890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361146-58e5-41c9-a38b-a652bc93ee69 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:29.497100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:29.520530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:29.521779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:29.522294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:29.522766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] PATH_INFO: `/v3/users/d4f741507d2b48f6a580c928ba000795` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:29.524172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] RBAC: Authorizing `identity:get_user(user_id=d4f741507d2b48f6a580c928ba000795)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:29.525810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a89566-a1e9-4697-9703-580d49bb248f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:29.528007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 160/333] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:29 2022] GET /identity/v3/users/d4f741507d2b48f6a580c928ba000795 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:29.535433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:29.568066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:29.642485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611171d-8ed2-4753-a5ab-ea42445d6a0e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:29.678983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:29.679859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:29.680141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:29.680418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] PATH_INFO: `/v3/system/users/d4f741507d2b48f6a580c928ba000795/roles/c76c68a7c19a476190a253a5b9c1946b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:29.681906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d4f741507d2b48f6a580c928ba000795, role_id=c76c68a7c19a476190a253a5b9c1946b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:29.683328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648a562-75d0-4f1f-8619-cbb897a6792a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:29.702481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 174/334] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jul 13 08:43:29 2022] PUT /identity/v3/system/users/d4f741507d2b48f6a580c928ba000795/roles/c76c68a7c19a476190a253a5b9c1946b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:31.027168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2ef3-386f-45c3-84e4-432fa81124f5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.028006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2ef3-386f-45c3-84e4-432fa81124f5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.028432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2ef3-386f-45c3-84e4-432fa81124f5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.030332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 161/335] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:31.036402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.037193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.037644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.055550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:31.057026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:31.132593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 175/336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:31.168660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2ef3-386f-45c3-84e4-432fa81124f5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:31.296482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2ef3-386f-45c3-84e4-432fa81124f5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:31.333727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:31.334551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.334833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.335107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.349020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e0e3f4f3-81aa-45b6-9d76-6157e1533f54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:31.356727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:31.358182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:31.358978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 162/337] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:31.364656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:31.386280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:31.411012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ccb8-0840-457d-85a1-0916f9faf1a1 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.411349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ccb8-0840-457d-85a1-0916f9faf1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.411593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03ccb8-0840-457d-85a1-0916f9faf1a1 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.414256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 163/338] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:31.421113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.421416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.421665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.453397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:31.454625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:31.518694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:31.560584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d727b1a-e0bd-4035-826c-d3e4ec84a2fa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:31.584573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 164/339] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:31.612878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:31.613903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.614411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.614909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.615878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:31.616395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:31.617962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:31.621959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:31.632117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 176/340] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:31.640982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:31.790034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:31.806978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9109-a68c-4979-942a-bd09f4898d1f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:31.810892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec413e-293b-4e21-8cd8-c97ff1f2c17e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:31.843697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:31.844882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.845386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.845859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.853463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:31.856436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:31.856747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:31.857116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:31.859073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:31.867716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:31.868606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:31.869372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:31.872145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 165/341] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:31.883099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:31.926134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:31.938793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:31.940452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.017599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cab25-1345-4fc8-9dc9-5673bbfcf4c7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.026462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.049352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 177/342] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:32.069942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.070640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.070930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.071208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.071957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:32.072262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.073643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.080997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.085690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 166/343] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:32.092315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.199284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947ec61-629a-47bc-b2e0-6a82c33f8ac4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.227927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.238545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12457-670c-41ca-94b4-da7410bbf09a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.241158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.242312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.242733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.243144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.244480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.246042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9893fc0-c5cf-44b0-a91c-8d9299cb00c6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.248869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 178/344] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:32.250303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5186-3112-4f2d-9509-c2bc754f81c5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.250793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5186-3112-4f2d-9509-c2bc754f81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.251259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff5186-3112-4f2d-9509-c2bc754f81c5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.252652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 179/345] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:32.254142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff5186-3112-4f2d-9509-c2bc754f81c5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.282914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.283573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.283878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.284159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.309661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.356801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.358796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.368078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff5186-3112-4f2d-9509-c2bc754f81c5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.404392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.405726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.407407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.407922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.414964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.417178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974e8f4-0cc3-466b-994e-528362f74244 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.419312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 180/346] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:32.421370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.421851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.422345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.440728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:32.442407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:32.459918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.471739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 167/347] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:32.472473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.520418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 181/348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:32.521746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.583473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c12bf-2ed3-4715-bb68-4cdb8fe59624 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.586532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.621400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.621986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.622334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.622683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.624025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:32.624340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.625773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.632157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 168/349] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:32.632993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.633560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5f8e-e35f-4288-b8dc-3248fafc7526 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.679418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.680368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.680648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.680920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.684612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.687660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.692311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 182/350] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:32.695351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.753985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.836189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a42e-c0f0-48ae-a3dc-82ee842f7930 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.849060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b56fb-21b1-46ca-8486-4dd59c9edba2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:32.863450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:32.885471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.886283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.886563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.886832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.888034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:32.889510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:32.891455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 183/351] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:32.897535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:32.898208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:32.899197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:32.899610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:32.900028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:32.921853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:32.930030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:32.931041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:32.931898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:32.939689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 169/352] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:32.946875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.099559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd953b-d2bc-4c48-ad81-22d1e2b663d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.104343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c4302-1183-4809-a556-ea928ea1a989 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.124923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.149681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.150782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.151216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.151631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.152530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:33.152972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:33.155297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd1e37-d236-44fd-b59a-396a9702a783 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:33.165313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 170/353] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:33.171392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bfef-fb9a-4427-9e9e-7db284bc8f28 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.171817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.172067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bfef-fb9a-4427-9e9e-7db284bc8f28 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.172497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4bfef-fb9a-4427-9e9e-7db284bc8f28 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.172757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.173132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.173504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.174485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 171/354] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:33.174803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:33.175215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:33.176032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635c60-7a20-4913-942e-417d14c99fb5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.176487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635c60-7a20-4913-942e-417d14c99fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.176910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635c60-7a20-4913-942e-417d14c99fb5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.177019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:33.178465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 172/355] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:33.179816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15dd5-57d8-461c-b479-244ae84f50eb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.180296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15dd5-57d8-461c-b479-244ae84f50eb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.180734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15dd5-57d8-461c-b479-244ae84f50eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.190812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 184/356] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:32 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:33.192173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.206331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8cc15dd5-57d8-461c-b479-244ae84f50eb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:33.207794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8cc15dd5-57d8-461c-b479-244ae84f50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:33.268028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.308581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 173/357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:33.310352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.310851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.311402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.328439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0f207-968a-4628-88b2-126c729ec575 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.345007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:33.347341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:33.371064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.371769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.372005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.372337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.447450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:33.449018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:33.452175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 174/358] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:33.453265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.509025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.515583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.592291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 185/359] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:33.593007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.651490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497d40c-0ac1-4ed3-bcbd-1aa4ed921e0b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.714402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.715554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.715669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df78feb-0681-416b-833a-2bf75c574101 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.716179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.716712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.740233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:33.758134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:33.759097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:33.759922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 175/360] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:33.760606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.765067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.765935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.766293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.766565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.786889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:33.801178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:33.802135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:33.802946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:33.803558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 186/361] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:33.804395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:33.820283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.932129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:33.938362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90e9cd-4b13-408a-80be-84eeec96e132 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.967303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab16a-5ba7-4e85-ac77-2cde59bf98e7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:33.977164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:33.978410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:33.978911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:33.979387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:33.980793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:33.983048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:33.985000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 176/362] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:33.985972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.011870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.012670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.012971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.013302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.014653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:34.014653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.015827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e203f01-c854-4157-b10e-3bed91dfcbd8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.026521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 187/363] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.027930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfbdd-94bf-4890-bc92-3bc69200ac5a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.028224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfbdd-94bf-4890-bc92-3bc69200ac5a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.028502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfbdd-94bf-4890-bc92-3bc69200ac5a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.029790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 188/364] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:34.031038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfbdd-94bf-4890-bc92-3bc69200ac5a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.125911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d66f-4e1b-463c-b326-618e5c97e299 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.134472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.175013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.175968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.176405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.176841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.178018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:34.178498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.178725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfbdd-94bf-4890-bc92-3bc69200ac5a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.180300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.190390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 177/365] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.191510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.219568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.220488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.220869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.221275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.222556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.224068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53139026-8f09-4579-aa79-d6cc82b1b81f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.224259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.226231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 189/366] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.233124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.233518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.234609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.251110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:34.252698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:34.306427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb667e-d123-4043-af28-d14b352bf851 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.321903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 190/367] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:34.323236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.343864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.345087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.345542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.345968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] PATH_INFO: `/v3/users/d4f741507d2b48f6a580c928ba000795` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.347956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] RBAC: Authorizing `identity:get_user(user_id=d4f741507d2b48f6a580c928ba000795)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.349664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.352040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 178/368] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/users/d4f741507d2b48f6a580c928ba000795 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.352982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.387298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.428632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842842d-0bd2-4cb6-9310-7aebb8940819 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.458891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.463994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.464713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.465267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.465642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.467636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227a24c-056e-42f7-bd5c-bd1342816029 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.505010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.505936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.506498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.506963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.508071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9fb50551187b49a29f80c36bb2fed27c) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:34.508586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.510430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.516851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 179/369] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.518133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.564826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.566737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.676130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.729689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 191/370] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:34.731196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.750038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122481b-ffd9-4ccc-b66f-b592a5d89862 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.800254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.801653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.802279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.802821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.804070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] RBAC: Adding query filter params (role.id=c76c68a7c19a476190a253a5b9c1946b, user.id=d4f741507d2b48f6a580c928ba000795, scope.system=all) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:34.804541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:34.806546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:34.823310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 180/371] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/role_assignments?user.id=d4f741507d2b48f6a580c928ba000795&scope.system=all&role.id=c76c68a7c19a476190a253a5b9c1946b => generated 510 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:34.824981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:34.875511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:34.876450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3087569-eedb-44ea-87ac-ecdf3088eba2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:34.929292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:34.930478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:34.930912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:34.931441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:34.957384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:34.973151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:34.974345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:34.975360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:34.981324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 192/372] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:34.987517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.048980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.066521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff0ba-2d31-4357-8c2e-9337ea63c3fa None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.107151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.108492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.108992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.109528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.111491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.113178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.115396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 181/373] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:35.122048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.166674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6f8ae-4330-4c4e-994e-d73387a72f1a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.249579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.250704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.250992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.251274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.252027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:35.252336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.254092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf7d4-e5c5-4847-80ab-2b8054f4b2f2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.267197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.270995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 193/374] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:35.272338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe472-4c6f-453a-b581-9d56f20ece7c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.273264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe472-4c6f-453a-b581-9d56f20ece7c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.273553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe472-4c6f-453a-b581-9d56f20ece7c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.275282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 194/375] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:35.280372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfe472-4c6f-453a-b581-9d56f20ece7c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.289707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d762-82da-41f6-9796-34182da4c676 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.327140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.328108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.328941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.329327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.331071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.332897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ac6b-63a1-4fc5-8d72-a066ec620490 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.335904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 182/376] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:35.337257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.338475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.338475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.362775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:35.364726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:35.391974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.414956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfe472-4c6f-453a-b581-9d56f20ece7c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.450577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.451423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.451807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.452175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 183/377] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:35.452308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.453340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.526356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.527929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.546694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.565207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9de1d-921a-4195-9dc5-74f527d384bf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.603739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.604743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.605233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.605720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.606819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9fb50551187b49a29f80c36bb2fed27c) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:35.607897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.609555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.616684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 184/378] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:35.617769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.637092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.647712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 195/379] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:35.655242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.735142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20485aa-b7b6-4ae1-8fb8-91ea3e18cd4c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.772756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.773801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.774345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.774766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.788339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:35.798501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:35.799397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:35.800170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:35.802152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 185/380] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:35.811063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.823705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:35.845057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1515dd1-da00-43fb-8aac-bc2822584db1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.920615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.921508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.921861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.922337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] PATH_INFO: `/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.926541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=ae57fca42c7a4eb0ba3859bea8e9d888)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.928064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:35.930000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 196/381] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:35.935632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:35.949385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ad77-a962-4d2d-b059-50196ec303cf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:35.991644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:35.992326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:35.992608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:35.992884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:35.993650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:35.993957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:35.995337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.015808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 186/382] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:36.023283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.032899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.115672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.117680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d46423-2b88-4aef-bfd4-09ea7c240ef2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.159801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9509-5cc7-4679-a5bd-e9eea50d3bc6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.165621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.166901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.167744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.168028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] PATH_INFO: `/v3/groups/d316c06628934ffba3356befd3f211d6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.175098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] RBAC: Authorizing `identity:get_group(group_id=d316c06628934ffba3356befd3f211d6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.177066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a6391-1938-4429-ae5e-7b904aafd6ba None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.179470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 197/383] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:35 2022] GET /identity/v3/groups/d316c06628934ffba3356befd3f211d6 => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:36.180777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82850a6-61d6-4cfb-b90c-de6c26eb65ff None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.181069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82850a6-61d6-4cfb-b90c-de6c26eb65ff None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.181348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82850a6-61d6-4cfb-b90c-de6c26eb65ff None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.182602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 198/384] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:36.187009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82850a6-61d6-4cfb-b90c-de6c26eb65ff None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.207813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.208679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.209069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.209345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.210662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.212108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5992d68-a5be-4f0c-83f5-5fc310e40f46 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.213859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 187/385] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:36.219626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.219911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.220296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.240202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:36.241497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:36.307385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82850a6-61d6-4cfb-b90c-de6c26eb65ff None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.319914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 188/386] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:36.320665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.336266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.366711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.367766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.368251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.368699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.369771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] RBAC: Adding query filter params (group.id=d316c06628934ffba3356befd3f211d6, role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=ae57fca42c7a4eb0ba3859bea8e9d888) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:36.370460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.378087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.385968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 199/387] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/role_assignments?group.id=d316c06628934ffba3356befd3f211d6&scope.project.id=ae57fca42c7a4eb0ba3859bea8e9d888&role.id=e3ea2fe66d56423a93654b34570d047c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:36.387047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.401822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.465245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258522-3b8f-4476-a247-469dadb8e46b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.520750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803fb1f-aa0a-414c-bc95-15dae544fb74 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.538146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.539030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.539355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.539579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.541737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.543318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.549877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 189/388] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:36.553307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.578077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.579963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.580635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.581103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.593932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:36.606506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:36.607524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:36.608328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:36.610867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 200/389] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:36.617922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.681844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.730558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a8f8-6ba3-4dcf-b827-0159c5f29b50 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.774749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.775639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.775917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.776188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.779507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, group_id=cf6640f95ad74b5e93379a99e76b0bf7, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.783664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.792351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:36.799632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958e5cf-af2d-4b3e-beb6-a432d03ca68a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:36.815987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 190/390] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jul 13 08:43:36 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:36.848499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:36.849185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:36.850956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:36.851248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:36.852006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:36.852315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:36.853746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:36.863982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 201/391] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:36.869665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:36.984286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e160a-e0d1-43bb-ae36-7efe94aedfae None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.033001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.033896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.034207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.034535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.035831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:37.037278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8b909-8fd7-4930-86ad-7783783ca69d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:37.039258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 191/392] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:36 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:37.045591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:37.127377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64619-9b13-492a-9033-7494534167d8 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.127659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64619-9b13-492a-9033-7494534167d8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.127932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64619-9b13-492a-9033-7494534167d8 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.129303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 192/393] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:37.134496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406247-c031-474f-9b74-6d00a203385b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.134898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406247-c031-474f-9b74-6d00a203385b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.135276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406247-c031-474f-9b74-6d00a203385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.156135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9b406247-c031-474f-9b74-6d00a203385b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:37.157339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9b406247-c031-474f-9b74-6d00a203385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:37.192833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b239-4b4c-43f5-9a96-499bc090deee None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.195178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:37.230025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:37.237734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.238624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.238907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.239181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.240477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:37.241903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:37.242509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 193/394] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:37.245478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 202/395] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:37 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:37.249083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406247-c031-474f-9b74-6d00a203385b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:37.267741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:37.421540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406247-c031-474f-9b74-6d00a203385b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.444081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321fdd8-dc30-486e-8b10-d090d01d56ae None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.497963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.498829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.499113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.499390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.503956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9f6c3f4dbc41499b7b9752256876b9, group_id=cf6640f95ad74b5e93379a99e76b0bf7, role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:37.505398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:37.512116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.512922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.513242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.513520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.534627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 194/396] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jul 13 08:43:37 2022] PUT /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:37.535318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:37.543334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:37.544972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:37.545842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:37.549885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 203/397] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:37.551148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:37.629581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:37.686282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f985a-fc60-47cf-8b41-683ccf3518ff None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.724060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.724752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.725034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.725308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.726065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:37.726393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:37.727773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:37.738080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 195/398] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:37.744214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:37.781146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:37.860701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658fd8-e36e-4a9a-b0a3-9f00fa8cc179 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:37.896741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:37.897637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:37.897917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:37.898225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:37.899490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:37.900967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:37.903095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 204/399] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:37 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:37.910194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:38.025510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ce1b-6539-4934-9d82-6177e6b917b4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:38.043011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:38.063099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:38.063979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.064265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.064545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.065750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:38.068351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1777eb-0c49-4348-ba98-958c4e27d978 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:38.070404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 196/400] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:37 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:38.076906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:38.192929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:38.201981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efaec-d715-4852-a702-6868defa4898 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:38.241136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:38.242025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.242331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.242614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.244545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, group_id=cf6640f95ad74b5e93379a99e76b0bf7, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:38.245992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b42ea3-97cf-4625-a981-257257e6fbca None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:38.274451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 205/401] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jul 13 08:43:38 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:38.525249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724d6f-f6e7-4b44-bffd-6ac8401ed82f None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.525746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724d6f-f6e7-4b44-bffd-6ac8401ed82f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.525841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724d6f-f6e7-4b44-bffd-6ac8401ed82f None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.527307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 197/402] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:38.533132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.533435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.533776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.556129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:38.556454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:38.637379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 206/403] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:38.664558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724d6f-f6e7-4b44-bffd-6ac8401ed82f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:38.797486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724d6f-f6e7-4b44-bffd-6ac8401ed82f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:38.838533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:38.839339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.839617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.839889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.861219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7b31af1d-fc24-45b2-8c35-ffaafb065fe7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:38.869646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:38.870549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:38.871338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 198/404] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:38.878648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:38.947722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd58d-da33-4bae-a14c-6eac0c576de8 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.948033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd58d-da33-4bae-a14c-6eac0c576de8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.948280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd58d-da33-4bae-a14c-6eac0c576de8 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.949915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 199/405] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:38.959446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:38.959725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:38.960000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:38.984751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:38.985950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:39.041412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.057124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b2a08-f2a3-4ecb-b6f0-8c20373f4a47 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.080115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.128896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.129973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.130569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.131050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.132079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:39.133373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.135096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.141268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 200/406] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:39.154702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 207/407] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:39.161071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.212760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.295070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c234f81-ba6c-4ede-a768-a6a2bb13ed3c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.336138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.336929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.337211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.337488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.338709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.340142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.342447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 201/408] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:39.350880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.374141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3dcc-4b93-47d8-9f24-480dbda0505d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.418679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.420982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.423251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.423251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.423251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.443173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:39.451932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:39.452809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:39.453589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 208/409] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:39.459862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.476250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8205e4-6847-49c5-83f3-f35fe191ec73 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.483987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.514920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.516034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.516490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.516899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.518481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.520080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.521969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 202/410] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:39.535115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.610492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340d81-dedd-4459-b635-45ae131223a6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.657021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262710bd-31a4-4217-b014-4c5291c09f61 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.661700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.662416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.662701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.662977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.663760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:39.664254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.666409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.670315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.684647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 209/411] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:39.690898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.698215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.699348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.699782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.700205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.703624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb50551187b49a29f80c36bb2fed27c, group_id=cf6640f95ad74b5e93379a99e76b0bf7, role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.705300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764d85c-71a5-4794-8ff0-fb02a13a9c67 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.727321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 203/412] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jul 13 08:43:39 2022] PUT /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c/groups/cf6640f95ad74b5e93379a99e76b0bf7/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:43:39.775028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b040-d6de-4b42-b9cb-04bcf959bb68 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.775323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b040-d6de-4b42-b9cb-04bcf959bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.775608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b040-d6de-4b42-b9cb-04bcf959bb68 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.781148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 204/413] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:39.782993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.783276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.783552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.797767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:39.804201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:39.805460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:39.840357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb53e0-9c3d-499a-af71-84ea18d63381 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:39.891220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 205/414] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:39.924584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:39.925461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:39.925744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:39.926018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] PATH_INFO: `/v3/groups/d316c06628934ffba3356befd3f211d6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:39.928649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] RBAC: Authorizing `identity:get_group(group_id=d316c06628934ffba3356befd3f211d6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:39.930139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:39.932442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 210/415] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/groups/d316c06628934ffba3356befd3f211d6 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:39.933701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:39.937790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.084848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58839c-0bc4-43a4-85c6-e450d912c92e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.091278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.095453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92885a-de4f-4960-91e0-25ed46e4eaf9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.137212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.138510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.138996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.139467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] PATH_INFO: `/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.140896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] RBAC: Authorizing `identity:get_project(project_id=ae57fca42c7a4eb0ba3859bea8e9d888)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:40.142624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:40.145306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 211/416] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:40.150377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.165728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.179749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.180561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.180845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.181120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.227263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:40.239223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:40.240139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:40.241378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 206/417] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:40.247997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.261994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618cc76-e0ce-4541-bcdf-def60e66515d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.298539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.299550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.299833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.300110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] PATH_INFO: `/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888/groups/d316c06628934ffba3356befd3f211d6/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.302144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae57fca42c7a4eb0ba3859bea8e9d888, group_id=d316c06628934ffba3356befd3f211d6, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:40.303642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:40.320583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 212/418] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Jul 13 08:43:40 2022] PUT /identity/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888/groups/d316c06628934ffba3356befd3f211d6/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:43:40.407881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336fd8-af6a-47b6-ac4d-d554cd03eb43 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.445082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.446132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.446614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.447105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.448051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:40.448548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:40.450097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd01c-af17-45d6-bfbc-29dc3edb8a48 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:40.463850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 207/419] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:40.465844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.561294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4dd8-812d-480f-ba14-9488fda51aa3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.562292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4dd8-812d-480f-ba14-9488fda51aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.562768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4dd8-812d-480f-ba14-9488fda51aa3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.564819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 208/420] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:40.571139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.571740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.572212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.586617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.595094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:40.597014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:40.626831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ccf5e-b956-4a71-aa3b-e0d2a0c3f514 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.632816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.675491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.676478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.677154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.677593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.690989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 209/421] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:40.715366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.766722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:40.768434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:40.821891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d2e4-122c-491e-973f-07943d4d936a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:40.839333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.858385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:40.859583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:40.859758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:40.860129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:40.871061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:40.877719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 213/422] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:40.886158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:40.887024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:40.887785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 210/423] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:40.890014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.895395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:40.925179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:40.992539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f3e59-0dea-4f68-a08a-4ae0c53075c1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.051709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.052586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.052869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.053141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.054397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.055835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.065796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 214/424] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:40 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:41.076845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.101678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393dece-1504-430c-b77b-73a5d57fdb1f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.139261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.139929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.140213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.140486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.141226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:41.141529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.142934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.151234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 211/425] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:41.156882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.157412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.234520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1ac3-4eb6-4aa4-a1f6-89dbabb7e6f5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.262338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.272899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.273648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.273934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.274237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.275422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.277046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ad02-45c2-4ba5-a4cc-09b4cc7c1a9d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.282247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 215/426] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:41.284065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e5004-ea80-4a8d-ab44-f6a884e4e986 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.284218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e5004-ea80-4a8d-ab44-f6a884e4e986 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.284470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e5004-ea80-4a8d-ab44-f6a884e4e986 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.293900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 216/427] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:41.293900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e5004-ea80-4a8d-ab44-f6a884e4e986 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.304239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a16-f86e-4a4a-999b-b91a2c9b65a8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.350610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.351281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.351564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.352340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.405537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e5004-ea80-4a8d-ab44-f6a884e4e986 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.413674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.444063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.445105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.445608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.446059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.447646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:41.448339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.449073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.450590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.451019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392260-f61c-4c78-95f7-89b92f5f784d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.460932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 217/428] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:41.460932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.460932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.460932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.479262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:41.481279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:41.563972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 218/429] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:41.586947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.612338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.667947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 212/430] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:41.674040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.693044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.696872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebcf4-6ddf-4c17-9477-1e78d621cbdf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.737707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.738966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.739447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.739919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.751252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:41.759124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:41.759993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:43:41.760806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:41.763187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 219/431] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:41.769211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.803423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed0bc-aef0-4c60-b7c2-2039a293c4b2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.841637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.842492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.842716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.842982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] PATH_INFO: `/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.844283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9f6c3f4dbc41499b7b9752256876b9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.845817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.850368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 213/432] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/projects/9c9f6c3f4dbc41499b7b9752256876b9 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:41.853640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.879521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2db00-ac84-4863-ae92-c8417000a54a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:41.901851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.918085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:41.918968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:41.919911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:41.920345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:41.921155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:41.921511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:41.922993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:41.931929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 220/433] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:41.937339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:41.963383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:41.971313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5bc4-81fd-469c-8f9f-7938577d9148 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.010054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.011366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.011858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.012328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.013800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.015489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.022251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 214/434] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:42.023900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.043156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216205-c924-40f7-9826-a32fa8d39c09 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.078457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.079170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.079452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.079729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.146997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccb6b-07a8-486b-822f-fa82387caf35 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.151858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.153317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.159886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.178565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.189279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.191320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.191837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.192310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.193337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:42.193859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.195995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a30f6-e3b6-4cd0-9fd4-2216daaf1c10 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.210149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 215/435] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9c9f6c3f4dbc41499b7b9752256876b9&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:42.233070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337fea-0b3a-4af7-a7dd-e5cb1e2beddf None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.233374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337fea-0b3a-4af7-a7dd-e5cb1e2beddf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.233690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337fea-0b3a-4af7-a7dd-e5cb1e2beddf None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.235388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 216/436] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:42.241044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07071-fe4a-453c-9446-614979285140 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.241329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07071-fe4a-453c-9446-614979285140 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.241604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07071-fe4a-453c-9446-614979285140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.260436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-50f07071-fe4a-453c-9446-614979285140 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:42.261589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-50f07071-fe4a-453c-9446-614979285140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:42.274649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 221/437] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:42.281624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.344238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 217/438] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:42.369568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07071-fe4a-453c-9446-614979285140 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.391753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771056d-54f8-412d-bfbe-487de68b3df0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.418997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.436153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.437334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.437969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.439614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.441134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.442882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.448437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 222/439] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:42.452273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.523977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07071-fe4a-453c-9446-614979285140 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.528254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.569815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.570672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.570858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08ff-0b97-4b01-86f4-c5371cb71b48 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.570960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.571229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.584904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:42.594805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:42.595714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:42.596530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:42.597123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 218/440] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:42.603959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.611685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.612842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.613317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.614312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.615747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.618058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.620542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 223/441] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:42.626916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.705814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.738011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a46b03-c122-4e41-917c-f7a7153c82a4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.758363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7a1d-be26-4d13-afd7-3694ec913ad7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.776524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.777194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.777475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.777748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.779010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:42.779010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.780246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.792595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 219/442] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:42.798254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:42.799235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.800084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.800439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.800723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.801569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=4df88e7f9eda45a4921f67b10624be9e, scope.project.id=9fb50551187b49a29f80c36bb2fed27c) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:42.801881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:42.803356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb99-6823-4a9a-b851-c2c38cb6cf95 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:42.809735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 224/443] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=4df88e7f9eda45a4921f67b10624be9e => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:42.831955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:42.912663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8eabd-281c-4d4e-a235-03455434e0bc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.912862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8eabd-281c-4d4e-a235-03455434e0bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.913144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8eabd-281c-4d4e-a235-03455434e0bc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.914718 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 225/444] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:42.915258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e5d-9785-47d2-a1ee-b94b9dd21b87 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:42.920811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.921103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.921378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:42.939281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:42.940521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:42.954872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:42.955528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:42.955809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:42.956154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.015065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 226/445] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:43.034920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.038150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.038305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.067405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.096940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.156390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2790-b42b-41fd-a623-8eb61943b2b9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.157702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 220/446] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:43.163359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.196318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.197120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.197398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.197667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.208510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:43.216974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:43.218045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:43.219115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 227/447] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:43.223792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.264975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a99ec-211f-4fb1-afa7-c63b5463c57c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.289964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.300448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.301296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.301584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.301854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] PATH_INFO: `/v3/projects/9fb50551187b49a29f80c36bb2fed27c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.303061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] RBAC: Authorizing `identity:get_project(project_id=9fb50551187b49a29f80c36bb2fed27c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.304517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.306233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 221/448] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/projects/9fb50551187b49a29f80c36bb2fed27c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:43.311789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.321923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1a9e-0dd9-4ed5-9d7f-de2f081cf08e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.336643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.359129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.359794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.360150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.360338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.361067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:43.361367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.362761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.370836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 228/449] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:43.376874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.412541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7a5d-4525-462c-b983-e5d7da8e895c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.445967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.446287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.446566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] PATH_INFO: `/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.447739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6640f95ad74b5e93379a99e76b0bf7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.449155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.450850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 222/450] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/groups/cf6640f95ad74b5e93379a99e76b0bf7 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:43.456628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.471684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bb2fc-129a-4efb-bea9-bb566286531d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.503845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.504486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.504769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.505044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.514694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.547620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.554167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5c78-6ae6-454a-819d-697771105b64 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.571536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.572976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.586082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.586761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.587044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.587324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.588148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] RBAC: Adding query filter params (group.id=cf6640f95ad74b5e93379a99e76b0bf7, role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=9fb50551187b49a29f80c36bb2fed27c) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:43.588466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.589882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.596083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 223/451] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/role_assignments?group.id=cf6640f95ad74b5e93379a99e76b0bf7&scope.project.id=9fb50551187b49a29f80c36bb2fed27c&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:43.674706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 229/452] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:43:43.680540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.783809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c93d77-346a-403e-836d-3d1522c280fd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.808870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.818288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.819153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.819434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.819708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] PATH_INFO: `/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.820889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] RBAC: Authorizing `identity:get_project(project_id=ae57fca42c7a4eb0ba3859bea8e9d888)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.822351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.824056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 224/453] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/projects/ae57fca42c7a4eb0ba3859bea8e9d888 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:43.830243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:43.905282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:43.930649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc615ff-7b7b-422b-9529-5547278d4f71 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:43.962920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:43.963776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:43.964082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:43.964336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] PATH_INFO: `/v3/groups/d316c06628934ffba3356befd3f211d6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:43.965491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] RBAC: Authorizing `identity:get_group(group_id=d316c06628934ffba3356befd3f211d6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:43.967620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c6bc7-94f1-42c3-99c7-edf7c146169c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:43.969222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 230/454] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/groups/d316c06628934ffba3356befd3f211d6 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:43.975214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:44.069722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd5f7-c5a0-400e-ad5d-b01c4835da19 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:44.102551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:44.103195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:44.103481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:44.103760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:44.104580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] RBAC: Adding query filter params (group.id=d316c06628934ffba3356befd3f211d6, role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=ae57fca42c7a4eb0ba3859bea8e9d888) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:44.104894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:44.106335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d28180-ff58-4d55-a4ca-02c027bbad56 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:44.112155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 225/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Jul 13 08:43:43 2022] GET /identity/v3/role_assignments?group.id=d316c06628934ffba3356befd3f211d6&scope.project.id=ae57fca42c7a4eb0ba3859bea8e9d888&role.id=e3ea2fe66d56423a93654b34570d047c => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:46.679776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5db4b-b47e-4b6e-baf3-e2e4b3fe4c7f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:46.680284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5db4b-b47e-4b6e-baf3-e2e4b3fe4c7f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:46.680360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5db4b-b47e-4b6e-baf3-e2e4b3fe4c7f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:46.681663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 231/456] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:46.687088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:46.687839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:46.688283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:46.711473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:46.712861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:46.739112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123fb2-b4a0-4eb9-aa4c-4e84c4165f24 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:46.739401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123fb2-b4a0-4eb9-aa4c-4e84c4165f24 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:46.739850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123fb2-b4a0-4eb9-aa4c-4e84c4165f24 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:46.741364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 232/457] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:46.746512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:46.746936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:46.747735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:46.777366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:46.781997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:46.783281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:46.797879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 226/458] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:46.834068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:46.895905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 233/459] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:46.923038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:46.996182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565626c-31a5-400f-8bcf-333284d881bb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:46.997077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.029465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5dff0-d1fe-4a97-91c6-4392cc0eebec None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.032574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.033540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.033986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.034442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.045443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.047169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.065946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-349bbd68-6e46-40b3-bde3-03740081377a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:47.066534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:47.067561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:47.068575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:47.068575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:47.068575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.068575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:47.068842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.068842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.068842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.070640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 227/460] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:47.072013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d0e4-2360-49a4-8246-f504169bb824 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.072444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d0e4-2360-49a4-8246-f504169bb824 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.072865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d0e4-2360-49a4-8246-f504169bb824 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.074534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 228/461] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:47.076425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09d0e4-2360-49a4-8246-f504169bb824 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.083972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.085501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9344a754-148a-4e4d-8356-928708f81c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:47.103345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:47.104380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:47.105418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:47.105418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:47.105418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.105418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:47.106669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 234/462] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:47.108150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.108648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.109139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.127703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:47.129256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:47.162482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.197999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09d0e4-2360-49a4-8246-f504169bb824 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.199296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 235/463] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:47.200414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.233309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.234339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.234809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.235285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.236200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:47.236710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.238395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.251404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 229/464] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:47.256199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.270269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.327570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836389ef-5421-42b4-8f47-9301fd6b87bc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.365207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.366300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.366786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.367262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.368197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:47.368702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.370280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.376406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.380341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39883-c1c8-4115-a019-e9a12d647192 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.383323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 236/465] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:47.383929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.420711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.421493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.421780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.422056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.422794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.424219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65b74d-a431-4065-9729-7ecd1d30111d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.444744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 230/466] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:47 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:47.446028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0be69-0e56-447b-bb90-b6ebb36c7f2e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.446358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0be69-0e56-447b-bb90-b6ebb36c7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.446660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0be69-0e56-447b-bb90-b6ebb36c7f2e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.448073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 231/467] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:47.453241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0be69-0e56-447b-bb90-b6ebb36c7f2e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.515259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d3cd-01d2-4ab4-87dd-2b6199d56ed4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.532915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.565814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.567220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.567926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.568455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.585699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.586778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0be69-0e56-447b-bb90-b6ebb36c7f2e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.587816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3845f8c7-a7a5-4fe9-b2d9-2ae42189a0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:47.614680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:47.615598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:47.616425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:47.616425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:47.616425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.616425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:47.616425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 237/468] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:47.618064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.618373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.618649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.633525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.634235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.634521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.634804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.635509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.636948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.638679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:47.640049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:47.659963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 232/469] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:47 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:47.660898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.678840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.753005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 238/470] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:47.787550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.800112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08ad2-e71b-4a08-b24c-a935ee4a834e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.850980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.851958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.853226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.853226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.853385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:47.853794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.855255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.871828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 233/471] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:47.879089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:47.907247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.914329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4023dcc-95e4-4ad3-b561-155e1e289559 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:47.958388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:47.959195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.959484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.959764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:47.964825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:47.970848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:47.972334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-99aeaa66-96cf-4b4f-b61f-b657f7d5f023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:47.992396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:47.993456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:47.994394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:47.994394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:47.994394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:47.994394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:47.994394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 239/472] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:47.995363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef154-3535-4328-b371-5db848e0031d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:47.995644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef154-3535-4328-b371-5db848e0031d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:47.995916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef154-3535-4328-b371-5db848e0031d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.001294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 240/473] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:48.002360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ef154-3535-4328-b371-5db848e0031d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:48.006692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682461-1b36-49fd-8676-badbf0027731 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.049896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.050565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.050806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.051080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.051802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:48.053248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409b1e0-791c-4911-88dd-a278f98c308f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:48.082344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 234/474] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:47 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:48.084184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.084706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.085196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.105705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:48.112874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:48.127092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ef154-3535-4328-b371-5db848e0031d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.173711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.174830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.175327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.175795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.177138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:48.177920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:48.180042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:48.192002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 235/475] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:48.208419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 241/476] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:48.213647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:48.219085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:48.238498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:48.327342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:48.378345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611c5d1-6e2e-41e6-84ef-ad66ec117502 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.387287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636aa42-6590-4c04-8851-a19f3f466dc9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.419157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.419879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.420163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.420455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.421263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:48.422876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:48.429772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.430757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.431045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.431863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.433098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:48.435244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:48.444491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.sql.core [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 08:43:48.444491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 08:43:48.444491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [parameters: {'id': '83497e8730f945c18580316678578970', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 08:43:48.444491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 08:43:48.447000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 236/477] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:48 2022] POST /identity/v3/users => generated 249 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jul 13 08:43:48.462772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return ref.to_dict() Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:43:48.463699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application yield resource Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise self.value Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application session.commit() Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 08:43:48.464588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.flush() Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application compat.raise_( Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 08:43:48.466025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:43:48.467449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:43:48.468230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [parameters: {'id': '83497e8730f945c18580316678578970', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:48.469007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 08:43:48.469798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:48.475011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 242/478] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jul 13 08:43:48 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:48.478029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:48.637850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd5b6-145a-4d91-b318-ec633929d9a3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.652744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:48.682471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.683292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.683572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.683847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.698327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9e526305-d8b0-4997-8543-6a97ca29fe0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:48.706683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:48.707580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:48.708411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 237/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:43:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:48.713579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:48.796546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:48.828893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b585779-9f6f-4b6d-bb70-2ae996ed2b58 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:48.871005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:48.872039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:48.873072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:48.873549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:48.874553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:48.875093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:48.876710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11613fb-a3a9-4832-872a-973dba187494 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:48.886942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 243/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:49.721869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04cf6-29ed-477d-bc59-33ede40b0681 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:49.722414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04cf6-29ed-477d-bc59-33ede40b0681 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:49.722414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04cf6-29ed-477d-bc59-33ede40b0681 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:49.723935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 238/481] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:49.729438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:49.729735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:49.730013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:49.755139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:49.756352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:49.844457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 244/482] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:49.888760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04cf6-29ed-477d-bc59-33ede40b0681 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.023332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04cf6-29ed-477d-bc59-33ede40b0681 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.066248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.067043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.067324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.067594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.091089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b6d4a86f-078b-42cb-8930-147107e2f17a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:50.098817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:50.099685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:50.100463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:50.102548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 239/483] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:50.107448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.202488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.222363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d12a-4386-45d7-873c-d8c134fabe6f None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.222988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d12a-4386-45d7-873c-d8c134fabe6f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.223462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d12a-4386-45d7-873c-d8c134fabe6f None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.228887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 240/484] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:50.230730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.231241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.231760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.250596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:50.252645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:50.261736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6d86-e7d2-4fc9-a44b-1596d5754f41 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.296528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.341735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 241/485] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:50.346083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.346083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.346083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.346083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.346412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:50.346412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:50.346412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:50.365345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 245/486] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:50.368726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.370443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.473622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e58b-800a-427c-a258-ef32e79b2ebf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.512656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.513481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.513762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.514031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.535276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:50.548928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:50.549794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:50.550617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:50.551723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 242/487] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:50.557916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.593701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.602222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fe02-9bcd-4d99-ab9d-791d7716be7d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.658844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.674841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.676000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.676518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.677009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.688963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:50.690730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:50.708078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:50.708925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:50.709825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:50.709825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:50.709825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:50.709825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:50.712125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 246/488] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:50.717564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.760419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626317-0784-4dc4-977a-5f9d78b356ec None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.813320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.813916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.814230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.814512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.815571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:50.815892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:50.817585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc5bf-7577-4ee3-b1d1-4ec5e4c8b7b9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:50.832946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 243/489] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:50.832946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcb62-43f9-469e-98d1-daa7c0a1e87a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.832946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcb62-43f9-469e-98d1-daa7c0a1e87a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.832946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcb62-43f9-469e-98d1-daa7c0a1e87a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.834230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 244/490] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:50.835196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdcb62-43f9-469e-98d1-daa7c0a1e87a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:50.846893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d6a5-f2cd-44e6-97ad-9df43101ac7b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:50.884060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:50.885287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.885784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.886300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.887225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:50.887760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:50.889327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3892b-a35f-4feb-b7cf-a0b79abef800 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:50.902499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 247/491] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:50.904728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:50.905232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:50.905792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:50.923838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:50.925525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:50.945412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.958997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:50.968810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdcb62-43f9-469e-98d1-daa7c0a1e87a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.001377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 248/492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:51.002808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.022161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.023275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.024441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.024911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.043076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.045717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:51.068431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:51.069256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 245/493] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:51.070523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.128975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0f316-d038-405e-b11b-208dc37dfad6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.165928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.167156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.167660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.168127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.179303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.181217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:51.198800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:51.199740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:43:51.201141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:51.203568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 249/494] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:51.204767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.205155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e85a-725e-4208-9120-4a96290d7366 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.237087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.242988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.243792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.244075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.244352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.253555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.258539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:51.269604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:51.270697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:51.271490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:51.279620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 246/495] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:51.280477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.318917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60464-3835-4165-bd08-4347cb23c428 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.355588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.356627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.357107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.357587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.358415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:51.358785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.360228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105ffb5-ec72-4210-a34a-fc15bb7e43b1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 250/496] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1a86-5a70-4bf7-9745-b87dc3560799 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1a86-5a70-4bf7-9745-b87dc3560799 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1a86-5a70-4bf7-9745-b87dc3560799 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 251/497] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:51.376966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1a86-5a70-4bf7-9745-b87dc3560799 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.391166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c046b-001b-4903-a3ad-ae1b8d6e1e20 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.429110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.429774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.430056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.430355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.431185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:51.431488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.432911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.468977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.470190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 247/498] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:51.470981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.488218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1a86-5a70-4bf7-9745-b87dc3560799 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.523656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.524325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.524598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.524875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.525611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:51.525758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.525911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.527343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6012e-9486-4473-961a-de95b800ab78 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.535971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 252/499] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:51.541760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.542031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.542330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.558276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:51.559470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:51.573057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a855349-6875-4233-9b25-21d58bf86f52 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.608203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.608989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.609278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.609555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.616435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.617885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.625551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 253/500] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:51.626619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:51.634059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:51.634942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:51.635804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 248/501] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:51.636334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.711420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.730782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6d5db-64b0-4fda-85b7-7768394b27ed None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.736430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09464629-fad6-4c94-9250-50cd967ee3cd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.752492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.764676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.765322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.765600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.765874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.771095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.771879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.772161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.772436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.782222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.783682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0127d9b0-c868-4536-9238-d42a422641b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:51.800929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:51.801939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 249/502] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec4b8-8427-4623-9e27-b24ff85acd92 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec4b8-8427-4623-9e27-b24ff85acd92 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec4b8-8427-4623-9e27-b24ff85acd92 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.807279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 250/503] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:51.807759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec4b8-8427-4623-9e27-b24ff85acd92 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.834870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.836273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.904850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec4b8-8427-4623-9e27-b24ff85acd92 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:51.913245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:51.933297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 254/504] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:51.934136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.938921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:51.939581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:51.939862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:51.940136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:51.940961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:51.941266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:51.942728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:51.959463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 251/505] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:51.960254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:51.985955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.033940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059581d-f4ae-4bd0-958e-e89328d2d9b9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.057376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcd6d-af33-4186-9663-53a26ec48a94 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.067048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.067838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.068129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.068400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.078035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-72cc60dd-b667-4a94-9686-1ef57fd5f793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:52.085786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.086699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:52.087481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 255/506] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.088116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.088791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.088791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.091844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.092370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.092657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.092933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.093823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:52.094932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.096306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.104203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:52.105424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:52.109412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 252/507] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:52.109412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.143533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.176090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 256/508] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:52.176900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.196247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.211328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a1a3-084a-468f-9ab2-d5c4d532f029 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.244141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.244920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.245203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.245478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.256399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.257837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:52.274228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.275108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.275923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:52.275923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:52.275923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.275923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:52.275923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 253/509] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.276184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.280670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cf2db-fccc-4572-a057-269ef8ceefbb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.313852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.314524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.314810 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.315083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.351869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.373814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf821e-79df-4b68-ae92-c14da156fddb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.380430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.381954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.406528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.407188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.407471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.407754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.408496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:52.408803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.410185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.414967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.422268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 254/510] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:52.423082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.478870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 257/511] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:52.479685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.521439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9585-a102-4756-9444-6bedf9de04fb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.546166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.556208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.556998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.557277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.557551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.564965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.566403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.576405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394f7e-27cb-444f-975b-b3c8a0a6c4e7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:52.580188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.581037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:52.581914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 255/512] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.582854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.611052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.611779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.612068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.612350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.622568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.624023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.639246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:52.641629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.642502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.643349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:52.643349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:52.643349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.643349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:52.643349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 258/513] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.643764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.685333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0062-5ba8-4802-84e5-cbc8a02c6909 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.718073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.718754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.719037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.719367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.720089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:52.720395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.721760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.733091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 256/514] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:52.733866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.741448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794949-9181-437a-b3c5-b3b2093f8d99 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.763174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.775601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.776387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.776669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.776944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.787534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.788980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:52.805887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.806792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.807630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:52.807630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:52.807630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.807630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:52.807630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 259/515] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.808071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.833013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1047-5bd3-4984-8a34-9d2f176a8a6c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.853865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:52.868103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.868835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.869123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.869398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.879149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.880588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:52.898266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:52.899285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:52.900149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:52.900149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:52.900149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:52.900149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:52.900149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 257/516] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:52.900676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.910917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd517-d3d7-4455-a1d5-fe0e0264c487 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:52.943013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:52.943675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:52.944194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:52.944301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:52.945044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:52.945351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:52.946795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:52.982392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 260/517] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:52.983418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:52.998339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5183f-baf8-4431-bd6d-885b2075dc16 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.013648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.031041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.031691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.031976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.032251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.032966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:53.033273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.034681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.047109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 258/518] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:53.047903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.077326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.085310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee0e8c-7858-4146-b30c-7ef32f5974cb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.119412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.120202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.120487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.120761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.127530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.129015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:53.143216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:53.144048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:53.144864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 261/519] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:53.145962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.146038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c618-a6d4-4283-aa98-7d8b7046895c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.181614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.182304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.182586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.182859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.183570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:53.183875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.185246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.196639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 259/520] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:53.201311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.236265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.245374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ed3eb-3f81-4be1-ac90-b99410f832ac None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.277411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.278076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.278941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.279220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.279934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:53.280242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.281619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.285437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.293269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 262/521] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:53.294635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.295532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d993b-b47a-460b-ab87-67d5e86e3ecd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.328229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.328878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.329164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.329442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.391712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f732e-be42-4e20-a79b-75967d8822b8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.396756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.398213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.424276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.424932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.425212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.425481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.426196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.427593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.447248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 263/522] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:43:53 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:43:53.448069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.460401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.507999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.521591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 260/523] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:53.526927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.564550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3e06-85b8-466f-a5cc-34d31d1eb13c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.603357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.604788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.604788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.604788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.605375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:53.605686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.607224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.625421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 264/524] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:53.625925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.646533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4eb4e-fc33-4685-abf6-19c3c1084796 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.694935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.696491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.697298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.697776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.701116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.708250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.709731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:53.730668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:53.731744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:43:53.732658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:53.733152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 261/525] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:53.733794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.736741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04949a28-c2cd-4887-b840-67023763ad13 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.777599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.778470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.778758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.779037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.785849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.787347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.795130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:53.801753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:53.802777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 265/526] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:53.808715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.857058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6417-1685-4da1-b1e0-8adf96a39e8c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.893862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.894685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.894973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.895247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.905502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.906892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.914967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7764-72ee-4c02-a8fb-31d459e17e16 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:53.924691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:53.925573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 262/527] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:53.927240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.949722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:53.958799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.959463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.959748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.960025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.960862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=a7608808e60846798f9063d98cf7a7bd) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:53.961164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.962614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.967993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 266/528] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/role_assignments?user.id=a7608808e60846798f9063d98cf7a7bd&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:53.968784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.051241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325ec2-5a0b-490e-a97c-44a3baf00152 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.055116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.090600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.092355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.092980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.093386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.094381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:54.094797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.096497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.117891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202352c1-b0fa-4fff-bbc7-ba0c4806d864 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.125571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 263/529] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:54.130157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.169443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.170044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.170362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.170644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.171435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:54.171748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.173334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.190997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 267/530] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:54.192026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.248529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.257842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2ba7-f046-45f4-96da-dd5e60651021 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.300842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451712-0ea8-4a75-9a7a-d89a21528eca None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.304881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.305773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.306290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.306856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.307785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:54.308344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.311000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.328706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 264/531] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:54.329562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.347122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.347991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.348277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.348976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.358498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.436413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.438236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.449565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5383e-92f3-4766-a195-53e99853bd3c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.485217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.485985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.486311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.486593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.487422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:54.487738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.489182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.499796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 265/532] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:54.499796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.500655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.603825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 268/533] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:54.605247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.610051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.639006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c98b42-b13e-45d2-8225-873c9a587b60 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.704659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.705391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.705675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.705952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.716917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.718953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:54.735414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:54.736453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:54.737475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:54.739658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 266/534] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:54.745167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.794082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab155cd-4bec-4395-a2c8-a1aca4f9c9dc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.853597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee39279-ff6c-43ac-9995-d13cd0b05390 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:54.861513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.862734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.862734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.862980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.882313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.883920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.895390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:54.896633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:54.897065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:54.897486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:54.898444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:54.900310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:54.902796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:54.917946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:54.919519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:54.920563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:54.920563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:54.920563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:54.920563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:54.923895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 269/535] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:43:54.928167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.933269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:54.948445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 267/536] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:54.954726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:54.964055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:55.122992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5535-4e17-4005-9f5b-16cca17f8296 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.132105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1de79-cfc8-42ac-b72c-8bac4a39ef4a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.183371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.184035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.184319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.185162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.186002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f0a69afb9bc648a1badcc9a58d5f0e18) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:55.186335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.187766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.196898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.197572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.197854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.198139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.198879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:55.199182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.200597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.209138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 268/537] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/role_assignments?user.id=f0a69afb9bc648a1badcc9a58d5f0e18&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:55.224105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 270/538] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:43:55.230431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:55.337104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:55.371593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966146-f8e6-45a6-b811-1dfdc2a89df3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.407447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.408243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.408522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.408796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.415942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.417394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:55.432195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:55.433046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:55.434320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 269/539] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:55.439017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:55.507103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:55.556604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e966-67a9-4818-a90b-812fdd187d8c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.605574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.606269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.607076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.607347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.608128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:55.608433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.609856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e885-3462-423a-a032-08c021fd682e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.628406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 271/540] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:55.633964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:55.686804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933c56-27b3-413b-93d8-5b675cbd53a4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.687164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933c56-27b3-413b-93d8-5b675cbd53a4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.687380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933c56-27b3-413b-93d8-5b675cbd53a4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.688969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 272/541] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:43:55.693956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.694312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.694597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.711920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:55.713902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:55.760800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e455598-e367-43d8-adfc-89d90e566f27 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.814053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:55.824787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.825490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.825777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.826056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.828446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 273/542] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:43:55.828632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=309b1c00398547b8b9924407e36bad8a) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:55.828965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.830444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.836669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 270/543] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:55 2022] GET /identity/v3/role_assignments?user.id=309b1c00398547b8b9924407e36bad8a&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:55.895434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:55.977279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:56.035884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e585-6a93-4e59-a41f-09076910a924 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:56.071380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:56.072192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.072476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.072751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.083202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:56.091573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:56.092398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:56.093171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 274/544] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:56.099989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.241175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c583-984d-47b9-8b5e-68fa32635ed9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:56.288027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:56.288627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.288917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.289197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.289946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:56.290286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:56.291930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc53b9a-42d2-41c6-9180-2ad8c27b6c14 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:56.305288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 271/545] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:56.311024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.463924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267466-cb20-426c-b2e4-2747a2283eee None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:56.485186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:56.486186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fad-977b-4fc4-8cb6-ad029ef84cd2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.486315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fad-977b-4fc4-8cb6-ad029ef84cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.486586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fad-977b-4fc4-8cb6-ad029ef84cd2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.488493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 272/546] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:56.493925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.494242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.494523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.514097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:56.515512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:56.524690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:56.525759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.526269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.526613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.549181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:56.549181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:56.573408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:56.574505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:56.575962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:56.575962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:56.575962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:56.575962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:56.584283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 275/547] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:56.589907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.605539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:56.647041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 273/548] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:56.681867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.756314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8b187-37f4-4fe9-bd7a-eb9a4b4e6cde None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:56.827038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:56.827627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.827907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.828182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.828903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:56.829265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:56.830850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:56.849637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f005eb-6743-4eff-81e6-e0b2e56c610f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:56.852605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 276/549] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:56.858758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.906474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:56.919381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:56.920187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:56.920474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:56.920745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:56.942905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:56.962758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:56.964218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:56.965192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 274/550] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:56.975079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:56.984993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef398d-67cb-4099-aa2f-3ce2e77796b6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.026122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.048242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.049388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.049918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.050415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.067517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.069347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.084637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b85cb-ffa1-448d-b779-75a425e40a31 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:57.102137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:57.103117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:43:57.104029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:57.107537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 277/551] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:57.113209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.124666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.125353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.125642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.125917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.126705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:57.127065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.128456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.137807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 275/552] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:57.143249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.217392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.234443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97283a21-1370-48e6-928f-dd1d00c49dad None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.269960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.270668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.270951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.271229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.271692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530f7f-65d6-47f5-b883-c37d49bcd22b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.272063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:57.272371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.273912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bcbae-2a7e-4ab1-8bbc-f3c62a83cded None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.281626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.295917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 278/553] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:57.297876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2415-9f83-40a0-b5d9-cb9d794bf69c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.298431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2415-9f83-40a0-b5d9-cb9d794bf69c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.298895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2415-9f83-40a0-b5d9-cb9d794bf69c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.300967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 279/554] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:57.301953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c2415-9f83-40a0-b5d9-cb9d794bf69c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.314617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.315413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.315696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.315979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.327547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.328995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-52492ce5-4df7-4ebf-a896-20a714968124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:57.346150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:57.347064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:57.347904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:57.347904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:57.347904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:57.347904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:57.351826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 276/555] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:57.353146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.353439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.353733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.377295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:57.379801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:57.424671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c2415-9f83-40a0-b5d9-cb9d794bf69c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.465190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 277/556] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:57.466920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.480397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.482092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.483217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.483811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.507079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.563006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.564725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f367d-a61d-46c2-b393-b8f442e67146 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.572944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.583681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b368a98-12dd-4596-b3f1-445f2b965836 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.618806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.619392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.619671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.619952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.620657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:57.620959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.622383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.633426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 278/557] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:57.633997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.681636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 280/558] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:43:57.683337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232d35-39f9-4eb5-8183-0b346e876ffa None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.683817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232d35-39f9-4eb5-8183-0b346e876ffa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.684298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232d35-39f9-4eb5-8183-0b346e876ffa None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.685872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 281/559] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:57.686762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232d35-39f9-4eb5-8183-0b346e876ffa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.738505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.748070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a6e5-600c-41df-a1b4-c69931fca492 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.782654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.783440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.783720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.784222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.795158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:57.803149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232d35-39f9-4eb5-8183-0b346e876ffa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:57.803279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:57.804123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:57.804943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:57.809419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 279/560] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:57.810170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.822925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:57.843724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.844524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.844808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.845084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.853242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.854752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2d393f6f-0468-420a-9b8c-545c098a77ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:57.870380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:57.871389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:57.872383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 282/561] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:57.872968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.873037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.873915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.889499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:57.890720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:57.924319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42216-0374-4c7f-8313-53dd67a7299e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:57.958517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:57.959306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:57.970303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:57.970451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 283/562] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:57.970549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:57.970634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:57.981396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:57.983155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:58.000903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.001909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.002838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:58.002838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:58.002838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.002838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:58.002838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 280/563] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.003109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.008278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.072697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.073030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89885-03b5-4037-8ac3-a99b14ab9a78 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.111040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.111717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.112001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.112284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.113211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.113374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.114727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.127971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 284/564] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.127971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.128208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679e9e-5657-4bd5-8d06-9a7071129e93 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.164737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.165973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.166461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.166933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.168001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.168496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.169949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.189128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 281/565] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.190080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.231225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.238221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461f22a-018d-4be9-af45-6710caf2f9d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.271836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.272657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.272943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.273223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.283436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:58.291666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.292772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:58.293824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 285/566] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.294676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.297808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c714-16ff-48a9-b7b6-ff9143882b32 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.318981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.334493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.335156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.335434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.335703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.336412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.336740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.338118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.349229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 282/567] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.349910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.392097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d658c4a-6810-44fa-99b7-e838c744fd9c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.425332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.426145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.426433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.426711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.437931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.439412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.446839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452d4ca-36ee-45a5-987a-a829ceac5730 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-af702cec-4720-4e21-a60f-c3baf645cbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:58.456662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.457724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.458774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:58.458774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:58.458774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.458774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:58.458774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 286/568] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.459110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4b2e-a3eb-4ef1-a595-5b6eba764b0d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.459296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4b2e-a3eb-4ef1-a595-5b6eba764b0d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.459581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b4b2e-a3eb-4ef1-a595-5b6eba764b0d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.461092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 287/569] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:43:58.461796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b4b2e-a3eb-4ef1-a595-5b6eba764b0d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.472401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.485762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.486571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.486851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.487122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.497931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.499396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:58.516649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.517697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 283/570] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.518840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.548125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.566318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b4b2e-a3eb-4ef1-a595-5b6eba764b0d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.599675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.600341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.600626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.600907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.601645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.601953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.603338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.611581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 288/571] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.612362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.620010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603abdf1-228e-4752-bc87-86c84297febc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.652966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.653721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.654008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.654329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.660843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.662399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3bdbd37a-fe62-49cb-bfc7-2c1d4539e143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:58.677190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.678334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:58.679522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 284/572] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.680100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.680190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.680404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.683620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.696788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:58.697999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:58.714289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079464-f0b0-4e28-8d2d-f5922685610e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.747667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.748321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.748600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.748875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.749577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.749877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.751257 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.761843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 285/573] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:43:58.766762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 289/574] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.766911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.767005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.788738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.864215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eeece-a328-4ef3-89c5-68edfd788b86 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.871158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11a19-e120-4675-b23f-a8b7791a1c9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:58.897402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.898061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.898375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.898652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.898992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:58.899365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:58.899670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.901291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.906296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:58.907033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:58.907319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:58.908171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:58.912307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:58.913089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.919244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:58.920702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:58.938539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:58.939592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:58.940789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:58.940789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:58.940789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:58.940789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:58.940789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 290/576] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:58.942952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:58.995580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.014171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b30a-a107-4e50-9c88-9b013e9d0c9f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.039146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c289-393b-4980-adf0-da142c5fa7c4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.047021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.047676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.047965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.048240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.049028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.049317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.050784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.062547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 287/577] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.063248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.077450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.078280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.078565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.078837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.085825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.087365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:59.101894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.102833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:59.103760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 291/578] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:43:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.104330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.149121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.164158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d1ac7-7c64-4e65-8ff1-7c50bb1f7980 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.197693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.198514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.198792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.199073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.204533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6d39-28a9-4a01-a6a9-914080eaceb3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.208664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:43:59.216785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.217775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:59.218644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 288/579] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.219331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.221158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.244233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.245018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.245303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.245575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.251974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.253396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:43:59.266681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.267716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.268864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.323741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3e2bd-3315-4815-89ba-9a4afec95495 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.356214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.357420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.357700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.357975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.358729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.359035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.360392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.368073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686d966-5219-49ca-b1c2-0ebbacf3efe2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.369536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.371608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 289/581] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.372426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.401294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.401937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.402250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.402526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.403873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=e317b8e3c61b456281c6f99da6c7a77b) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.404183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.405581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.410839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 293/582] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/role_assignments?user.id=e317b8e3c61b456281c6f99da6c7a77b&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.411599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.451153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.502954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7cba-03fa-4a06-bd3a-e40754f853ed None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.521725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c491-4ef9-4bb2-8492-e3d8b439be10 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.542012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.542724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.543009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.543284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.544143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.544445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.545905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.559408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.560321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.560798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.561069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.561815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.562140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.563514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.564981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 290/583] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.565826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.577077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 294/584] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.577909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.608798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.676939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041e42-5336-44c9-8286-73b528c4b21a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.682532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d150a-d749-4049-af53-b1cae4191049 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.697576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.715327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.716462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.716744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.717013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.717850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:43:59.718093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.719541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.721130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.722002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.722379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.722725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.730598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.736203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 291/585] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:43:59.736334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.736428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:43:59.751778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.752948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:43:59.754094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:59.755129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 295/586] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.755827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.849560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af3093-2779-4a07-994b-eaf3baaea557 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.850548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:43:59.864903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12489f8-ff76-4095-b34e-107eddc53e1a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:59.886574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.887384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.888362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.888634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.899726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.900063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:59.900916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:59.901161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.901323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:59.901661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:59.912232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:59.913734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:59.919812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.920841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.921768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:59.921768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:59.921768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:59.921768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:43:59.921768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 292/587] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.922054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:43:59.937173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:43:59.938299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:43:59.939186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:59.960031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.032443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30435-4dd3-4abd-ac15-50c1714e77ed None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.043686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214ad0c-4a28-4ae8-9a90-c1e769ce5d5d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.070891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.072103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.072623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.073162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/a7608808e60846798f9063d98cf7a7bd/roles/93233f8df513407186508b6223a04630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.078436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.079108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.079391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.079669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.080620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.080936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.082393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.089163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=a7608808e60846798f9063d98cf7a7bd, role_id=93233f8df513407186508b6223a04630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.091016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.091528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.099968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 297/589] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:43:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.100841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.107451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 293/590] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:43:59 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/a7608808e60846798f9063d98cf7a7bd/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:00.108441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.228142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.248812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e5a7-9bf5-4300-9820-3f70fdc3e92a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.249773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6c947-0240-4f14-adc7-c866919edda5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.286846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.289008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.289008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.289008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.289008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.289355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.290937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.295543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.295712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.295894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.296148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.296875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.297182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.298918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.307068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 294/591] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.307217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.311582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.315051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.378468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.422978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911651-c345-440d-8ffa-a15f36bf8628 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.426554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2179-989e-46d4-a26a-692e606d4b79 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.459202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.459970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.460253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.460529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.463454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.464601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.465033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.465486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.468921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.470381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.478660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.480310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:00.485544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:00.486678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:44:00.487809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:00.491417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 299/593] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:00.492287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.493382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:00.507378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:00.508349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:00.509219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:00.509219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:00.509219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:00.509219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:00.510735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 295/594] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:00.510735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.614449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f6029-8fa0-4447-adf7-0da62f617b63 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.633043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.650841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f709e4-6ce0-46a3-830c-a27f1c79e626 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.651821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.652859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.653856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.654387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.661507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.663199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:00.683206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:00.684105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:00.685009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:00.687354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 300/595] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:00.688324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.696839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.697645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.698029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.698428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.699977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.700390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.702472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.726856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 296/596] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.731046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.785478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.805785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b685e-be85-47dd-97e1-4f07cc152d21 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.835360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cabb99-d3f2-448d-9445-3fe0f97d58c3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.843697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.844662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.845300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.845777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.846879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.847389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.849081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.864398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 301/597] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.865725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.872001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:00.872666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:00.872950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:00.873227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:00.874016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:00.874353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:00.875769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:00.893101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 297/598] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:00.893101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:00.917864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:00.985270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29258eb-651c-452b-bd04-5d448cdff68a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:00.991174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bd54-b4ef-434e-9ba9-b41a066e97f4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.004071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.024401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.025548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.025929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.026330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.026748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.027711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.028676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.029110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.036472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.038218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.038343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.039819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:01.053374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:01.054443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:01.055547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:01.057387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 298/599] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:01.058539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:01.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:01.062269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:01.063144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:01.063144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:01.063144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:01.063144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:01.067660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 302/600] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:01.068565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.166067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcb7f-415c-4d67-af53-17948b3f4467 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.167174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.179094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14985de-9fed-4deb-b8e3-6932060dcb74 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.202703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.203968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.204434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.204885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/93233f8df513407186508b6223a04630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.215260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.216618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.216973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.217322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.218313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:01.218694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.220300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.222708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=f847d12027be4164aff8449a2bd42750, role_id=93233f8df513407186508b6223a04630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.224430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.235099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 303/601] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:01.236137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.240535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 299/602] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:01 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:01.242064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.272295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.366248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b748-c0b7-4832-b397-389f398111e9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.406713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.408132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.408598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.409168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f0a69afb9bc648a1badcc9a58d5f0e18/roles/93233f8df513407186508b6223a04630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.415030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8fc5-e8b9-46dd-a539-28aacdfccd4c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.427676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=f0a69afb9bc648a1badcc9a58d5f0e18, role_id=93233f8df513407186508b6223a04630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.429541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839fd2-51ac-428b-94ed-8070a3d942dc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.462691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 300/603] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:01 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f0a69afb9bc648a1badcc9a58d5f0e18/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:01.464896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2d53-e7ab-4220-af83-bc99b6c74202 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.465459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2d53-e7ab-4220-af83-bc99b6c74202 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.466003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2d53-e7ab-4220-af83-bc99b6c74202 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.468250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 301/604] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:01.474196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.474196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.474196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.474522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.474627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.474701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.475002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.475098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:01.477406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.477406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.494024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:01.495315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:01.506380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 304/605] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:01.511955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.535109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.599143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 302/606] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:44:01.623334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.627278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.692017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926d6d-1bae-435b-a8b7-d8775af70863 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.737901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.738899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.739185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.739464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.750962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.752840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.760956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fad17-df98-4858-90d0-083dfccd5ac2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:01.772885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:01.774017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:01.775211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 305/607] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:01.780764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.806926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.807980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.808898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.809410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.823885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:01.833733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:01.834936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:01.835954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:01.839009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 303/608] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:01.844923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.874389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.913097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:01.914722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174c1c6-fdfa-446b-bfdb-5ea7251d6e46 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.960134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848cc43-c978-46d0-911d-c53b14c61a03 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.965091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.966470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.966856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.967233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.968124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:01.968535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.970837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.988501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 306/609] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:01.995447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.003519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.004472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.004905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.005360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.006285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:02.006785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.008311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.017604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 304/610] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:02.023348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.131756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74a33-3c80-48f9-b78d-a8e083a70ff3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.156847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:02.170595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.171691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.172161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.172519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c631c6-a5e1-4de5-b2cf-5cfc197868b2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.172843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.184469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.186288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.202148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:02.205122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:02.206068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:02.206980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:02.206980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:02.206980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:02.206980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:02.209118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 305/611] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:02.215005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.223759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.224769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.225125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.225471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/309b1c00398547b8b9924407e36bad8a/roles/93233f8df513407186508b6223a04630` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.253169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=309b1c00398547b8b9924407e36bad8a, role_id=93233f8df513407186508b6223a04630)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.254776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.281126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 307/612] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:01 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/309b1c00398547b8b9924407e36bad8a/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:02.326316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982d22-dd3c-49f7-90aa-e9db38910d15 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.364366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.365340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.365808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.366316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.367224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:02.367713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.369289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5f3e6-497c-47c1-98df-89d877ee2a2f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.383820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 306/613] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:02.390182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.425974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279fb9-6804-47ca-8907-611a4bbb7699 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.426340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279fb9-6804-47ca-8907-611a4bbb7699 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.426626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279fb9-6804-47ca-8907-611a4bbb7699 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.428399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 307/614] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:02.439837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.440175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.440397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.470992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:02.472154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:02.515616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828dd8e-7b56-43de-a9d5-b7847b520cb0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.544124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:02.553717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.554499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.554785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.555060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.563693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.565147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:02.580499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:02.581453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:02.582398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 308/615] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:02.587456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.599350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 308/616] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:44:02.634260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:02.640618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.743101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909d85-70d2-42f5-bb0b-67df5c721852 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.783099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.783916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.784198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.784471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.785321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:02.785609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:02.787204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:02.806697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 309/617] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:02.816169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:02.852223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a7ac-5bed-4592-96b3-0d82fbef59d4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:02.916529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:02.917530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:02.917817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:02.918092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:02.938234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:02.946228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:02.947115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:02.947944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 309/618] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:02.956258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.005638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.008505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.017828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c01de-4829-4a2e-9288-4ec8dbca0f9a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.086460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc649-bb14-459c-8ae3-77d122af405c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.112226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.113043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.113326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.113592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.121549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.122870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.123154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.123432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.124232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:03.124548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.125932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.135182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 310/619] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:03.140681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.150955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.152414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:03.183234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:03.186059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:03.188170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:03.188170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:03.188170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:03.188170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:03.194655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 310/620] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:03.207233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.238488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.253290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ac34-4641-4dbf-a0dd-1040aca6c813 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.289331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.290141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.290443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.290969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.302896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.304452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:03.323454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:03.325572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:03.328169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:03.328169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:03.328169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:03.328169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:03.328169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 311/621] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:03.331269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.440317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223c0f-863a-43a1-8c9a-509d6e800f66 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.454484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269bee-2c23-400d-a9d2-5ceba8b1b3c1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.476591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.477260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.477544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.477819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.478576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:03.478882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.480351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.491256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.495590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 312/622] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:03.501602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.517728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.524149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.539636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 311/623] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:03.541082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.559467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.624049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db44ef-e532-4838-90ff-586c8e421d58 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.667041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.667910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.668198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.668474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.677884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.679964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:03.696382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:03.697378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:03.698350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 313/624] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:03.703718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.771904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.803294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ed57f-bb36-4fc6-bcc2-c12436e32886 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.830490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045eef-4890-4615-8ab1-7cf28b756df0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:03.838364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.839273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.839627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.839974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.848012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.849624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-00982e99-74e7-4139-9e86-7875dadf7e3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:03.866599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:03.867541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:03.868421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:03.868863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 312/625] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:03.870489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7910-a9a3-45fb-b652-e379de8a1811 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.870794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7910-a9a3-45fb-b652-e379de8a1811 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.871160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7910-a9a3-45fb-b652-e379de8a1811 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.872768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 313/626] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:03.873770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7910-a9a3-45fb-b652-e379de8a1811 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:03.884274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:03.885194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.885576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.886060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.887005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:03.887896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:03.889618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ff7d-186d-4e84-92a2-963d8bf4f78d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:03.914873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 314/627] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:03.916430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:03.916721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:03.916999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:03.938507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:03.939816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:03.956609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:03.989459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7910-a9a3-45fb-b652-e379de8a1811 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.015602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 315/628] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:04.016934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.024747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.025460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.026037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.026280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.027100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:04.027459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.029491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.046246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 314/629] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:04.048353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.082173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.138710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd21c9-c51d-44ad-8ea6-ba1d5bc175c6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.155006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44264b-e4a5-462f-83c1-d9a1fad3839c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.175702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.176352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.176639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.176916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.182753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.189108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.189996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.190319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.190587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/e317b8e3c61b456281c6f99da6c7a77b/roles/93233f8df513407186508b6223a04630` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.207298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=e317b8e3c61b456281c6f99da6c7a77b, role_id=93233f8df513407186508b6223a04630)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.208745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.222466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 315/630] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:04 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/e317b8e3c61b456281c6f99da6c7a77b/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:04.223495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.269373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.273694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c679acb-a886-4898-ae6c-7c9eab6d2f25 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.331571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.353571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1def043-73b2-40e4-b8f7-5f13b29bc5c6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.391199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 316/631] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:04.392477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649c54-352f-4120-a5cb-24d4898739d7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.392771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649c54-352f-4120-a5cb-24d4898739d7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.393050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14649c54-352f-4120-a5cb-24d4898739d7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.395600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.396635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.396914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.397184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.398566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 317/632] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:04.399616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14649c54-352f-4120-a5cb-24d4898739d7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.408961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b23af6ec-fd22-47f2-8a56-0a84da15b327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:04.416933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:04.417934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:04.419124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 316/633] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:04.420159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.420159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.420159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.438382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:04.439577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:04.479007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.517022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 317/634] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:04.518411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.523946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14649c54-352f-4120-a5cb-24d4898739d7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.566197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.567602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.567985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.568490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.582152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.584543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.598283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:04.611674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:04.612792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:04.613903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:04.613903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:04.613903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:04.613903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:04.616453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 318/635] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:04.617647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.643986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362be7b-99fd-4895-9265-6227b1305255 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.689616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.691293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.691911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.692521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.693732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:04.694650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.696495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.707783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 318/636] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:04.709499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.740907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669fe25-01bb-4819-8687-5476b9a6be50 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.750596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.787729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.788870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.789591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.789945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.803878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:04.815130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:04.816084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:04.817069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 319/637] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:04.817967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.838461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f785d-b52f-4ab1-b643-3d6a49c9fbb3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.876253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.876886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.877114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.877386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.878095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:04.878431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.879786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.889895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:04.895758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 319/638] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:04.895758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:04.941014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3080a-a573-4ded-86fd-cd0175ac0732 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:04.973885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:04.974809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:04.975094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:04.975367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:04.986914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:04.988349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:04.998409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3598e4c0-419b-4ffc-b1ca-a8575a8ca779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:05.006599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:05.007485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:05.008353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:05.008353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:05.008353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:05.008353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:05.008580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab916d7-0fc9-4b11-a653-ff006b7d596d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.010467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 320/639] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:05.011513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ba-7212-4368-9685-b79833c214a7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.011791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ba-7212-4368-9685-b79833c214a7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.014192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae9ba-7212-4368-9685-b79833c214a7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.018153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 321/640] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:05.018153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae9ba-7212-4368-9685-b79833c214a7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.048972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.049983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.050453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.050918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.051800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.052256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.053880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.063689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 320/641] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.064615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.132836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae9ba-7212-4368-9685-b79833c214a7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.145968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.170559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.171360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.171696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.171992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.174739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2b98-5cd4-47ed-bfbc-bbd073775def None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.178814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.180257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-68599d8d-c43d-4e82-9776-e8159aeeca4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:05.195405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:05.196533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:05.197833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 322/642] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:05.198407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.198407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.198600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.213249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.213905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.214231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.214509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.215222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.216051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.216831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:05.217397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.218012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:05.229516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 321/643] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.230100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.249060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.295154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 323/644] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:05.295889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.349393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627383-4fa2-48af-a765-b054d8e94058 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.390448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.391176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.391746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.392033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.400311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf2f1a-44e9-47ae-8fc1-e644da7baeb3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.402198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.404189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.405783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:05.424829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:05.425775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 322/645] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:05.427281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.442926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.444007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.444295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.444716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.445552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.445868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.447322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.460114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 324/646] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.460738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.507204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.545338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5230f-8807-4cd5-a98d-83a405aed2b5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.567753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0efa-3676-4558-9018-91ba77670852 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.582764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.583556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.583837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.584272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.592287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.594270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.601517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.602330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.602613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.602887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:05.608655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:05.609603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:05.610584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 323/647] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:05.611196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.618151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:05.625900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:05.626976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:05.627843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 325/648] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:05.628526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.657848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.719541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6dce6-b88d-479a-84e3-ddb506b54ce2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.736551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76803e38-4a29-4b84-a982-6c65e975e7b2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.746023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.756444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.757228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.757511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.757787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.758535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.758841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.760454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.771153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.771802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.772081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.772351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.777716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=a7608808e60846798f9063d98cf7a7bd) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.777871 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 324/649] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.777969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.778070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.778178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.783377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 326/650] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/role_assignments?user.id=a7608808e60846798f9063d98cf7a7bd&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.784039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.911160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864173-7ea3-4edf-93e9-b1fcf078f703 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.920770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:05.944609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb7bc6-2f0a-495e-8d87-d89d9581eb19 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:05.951545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.952525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.953019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.954073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.955166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.955697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:05.957390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:05.980434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 325/651] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:05.980434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:05.995483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:05.996484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:05.997450 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:05.997730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:05.998849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:05.999161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.001233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.011579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 327/652] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:06.012254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.034333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.134154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a270b1c-2ba8-4b16-92b4-137c96df13ca None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.134494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f440f6-e58d-4f98-96ef-bbba4ab9606b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.186528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.187243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.187532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.187804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.188923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.189560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.189834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.190099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.205831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.207310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:06.226587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:06.227582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:06.228532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:06.229209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.232256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.315055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.316516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.397759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6c56-9bd6-4183-acb7-ed6493684bdc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.402076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.444438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.445151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.445543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.445784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.460886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.463497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.469229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 328/654] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:06.471024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4861eb91-0980-459c-b30f-1820515b1cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:06.487852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:06.488785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:06.489670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:06.489670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:06.489670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:06.489670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:06.493568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 327/655] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:06.494912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9907-a596-4b4a-bbe8-d7f4c0777483 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.495193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9907-a596-4b4a-bbe8-d7f4c0777483 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.495460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9907-a596-4b4a-bbe8-d7f4c0777483 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.497009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 328/656] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:06.497695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9907-a596-4b4a-bbe8-d7f4c0777483 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.534347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.591707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0956f-28e1-4f16-b242-2936231c99d1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.613996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9907-a596-4b4a-bbe8-d7f4c0777483 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.627697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.628285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.628570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.629074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.629675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:06.629987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.631442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.653779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 329/657] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:06.653779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.655182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.655972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.656252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.656516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.667219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.669204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-52f7e9aa-4501-4d8e-92c4-b2e6ccac5acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:06.687255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:06.688338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:06.689340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:06.689340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:06.689340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:06.689340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:06.689340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 329/658] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:06.693908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.694288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.694621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.710153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:06.711328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:06.713225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.763493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5799-6015-4894-a173-275b83e9b1e1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.772000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.782141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 330/659] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:06.782141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.813660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.814365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.814650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.814923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.815638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:06.815942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.817298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.833463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 330/660] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:06.833463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.885944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886b12-c760-4b93-93dc-9e3ccf936a1c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.921594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.922294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.922553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.922833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.930749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:06.942299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5ae71-23ae-4b35-b26a-e248a8e45442 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:06.977989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:06.978613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:06.978897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:06.979170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:06.979881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:06.980185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.981573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:06.993383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:06.993888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 331/661] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:06.994729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:06.995560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.025954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.104364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0091b-cb7a-4777-8dac-881d08ab6cc8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.105001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 331/662] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:07.110362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.143382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.144423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.144703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.144979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.154055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.155801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:07.163462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:07.164405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:07.165241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 332/663] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:07.166772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.226558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79035d-2e9b-4944-b315-6cd5341a4cd9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.254273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.264895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.265689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.265973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.266282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.270367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756776-66dc-43b3-b647-2644071c7027 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.273051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.274518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:07.288934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:07.289983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:07.291203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 332/664] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:07.291822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.311617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.312495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.312848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.313220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.320221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.321655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:07.336555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:07.337431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 333/665] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:07.338701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.397073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.401952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f686-d4ba-43e8-83a3-79b57161e588 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.437599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.438423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.438707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.438983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.448203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfead3d-228a-4451-a3fd-3a6d2d32dc3b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.449135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.451226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:07.469292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:07.470314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:07.471196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:07.471196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:07.471196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:07.471196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:07.471196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 333/666] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:07.471477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.490096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.491006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.491116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.491357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.492099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:07.492405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.493764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.502470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 334/667] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:07.503266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.516965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.580870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6197f-3651-4742-8276-a4e8c1d0bfc6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.615456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.616138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.616419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.616698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.617530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:07.617839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.619296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.620860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda053f-31a7-4568-8a44-b5490a3726fc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.636944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 334/668] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:07.637804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.648659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.663452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.664114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.664395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.664667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.665769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:07.666079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.667534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.680491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 335/669] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:07.681289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.745898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957cb3-94c5-4997-a092-708260df49cb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.750943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.784640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.785305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.785578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.785857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.786038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f206fb-763b-4459-bc8a-4da9859413b5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.786606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:07.786910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.788829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.804695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 335/670] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:07.804695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.831182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.831976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.832260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.832613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.843630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:07.845083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:07.865096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:07.866008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:07.866938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:07.866938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:07.866938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:07.866938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:07.866938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 336/671] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:07.867229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:07.880053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:07.915780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192c8a-7eed-4cc1-b4b8-fa0f23511126 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.950860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:07.951499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:07.951772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:07.952047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:07.975555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a9d1-9d16-480b-b619-f9ce2f4426c1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:07.995563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.009700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.010377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.010657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.010933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.011750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:08.012080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.013507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.017839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.019265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 337/672] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:08.019385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.020031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.099136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.138064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 336/673] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:08.139025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.146549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc96a-28c9-446f-862b-4077bc7f1aa6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.188737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.189868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.190171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.190451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.197375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.199308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d42854ce-b0f4-47db-9274-4febc28801ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:08.215091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:08.216542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:08.217442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 338/674] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:08.218005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0260-92c9-459b-add0-688ee8c6402e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.219141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0260-92c9-459b-add0-688ee8c6402e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.219451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a0260-92c9-459b-add0-688ee8c6402e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.220682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 339/675] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:08.221374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a0260-92c9-459b-add0-688ee8c6402e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.265072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088fc1-3b26-4a74-8e71-45a7f74e9da2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.281853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.301247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.301907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.302220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.302493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.303198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:08.303497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.304846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.320340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 337/676] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:08.320340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.344010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a0260-92c9-459b-add0-688ee8c6402e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.346745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.380495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.381598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.382044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.382502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.393509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.394960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-802c3afa-5c20-43c5-a441-153f3d6dc371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:08.412877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:08.413833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:08.414759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:08.414759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:08.414759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:08.414759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:08.414759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 340/677] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:08.415461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.415807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.416258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.428169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484ece-837e-485c-b3a7-db8efaad5433 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.432392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:08.433569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:08.462565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.463240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.463527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.463800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.464577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:08.464878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.466849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.481096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 338/678] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:08.481096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.511996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 341/679] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:08.513266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.547829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.593569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.606797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87608c-4e16-467c-86b2-12d4e6f2e787 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.619546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24130a-fed9-4409-b332-6f19a9ed42e5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.642859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.643593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.643873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.644145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.651231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.652650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.657107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.657774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.658060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.658365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.659084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:08.659623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.660912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:08.667673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:08.668681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 339/680] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:08.669631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.677311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 342/681] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:08.678308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.775210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.777672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9eec3-eeb2-4963-be97-3f814fda422d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.793511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1884-ce3a-42ab-9990-fd1a1870d78b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:08.814721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.815388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.815676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.815953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.816785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f0a69afb9bc648a1badcc9a58d5f0e18) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:08.817146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.818600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.824654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 340/682] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/role_assignments?user.id=f0a69afb9bc648a1badcc9a58d5f0e18&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:08.825997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.837626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:08.838579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:08.838936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:08.839276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:08.852676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:08.856362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:08.857196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:08.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:08.883063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:08.883948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:08.883948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:08.883948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:08.883948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:08.883948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 343/683] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:08.884671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:08.984639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb3643-3636-43a2-8a7f-2ae6f3deac9f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.000842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9b19-d4f5-4b0e-b688-9ba58d744ef8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.021018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.021701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.021986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.022299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.023145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:09.023870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.024878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.038863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.039731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.040014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.040285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.045422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 341/684] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:09.046601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.049047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.050873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.052705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:09.067451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:09.068549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:09.069593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:09.070016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 344/685] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:09.070785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.136136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.171141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6faae-7c8c-4db7-8839-dfd93390ac9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.191096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3376-7379-4c1c-8212-1b26ea001eaf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.209152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.209824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.210125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.210507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.211445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:09.211753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.213120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.226246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 342/686] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:09.227136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.229191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.229958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.230291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.230666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.300445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.303972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.305444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.335117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654cd3-2e0d-477f-a62f-7008e61fbde4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.365424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.372690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.373664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.374094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.374535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.375460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:09.375916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.377715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.391862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 343/687] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:09.393034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.416438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 345/688] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:09.417211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.494583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263f24-7d06-4b0c-b796-f184f6d74721 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.522493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873fc2e-63b0-4743-89c4-90d4b574d717 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.530594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.531537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.532025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.532525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.533425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.534443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.535304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.561156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.561744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.562029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.562336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.562887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 344/689] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:44:09 2022] POST /identity/v3/users => generated 254 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:09.563172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=309b1c00398547b8b9924407e36bad8a) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:09.563484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.563818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.565108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.578386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 346/690] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/role_assignments?user.id=309b1c00398547b8b9924407e36bad8a&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:09.622528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:09.689752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f732-e1c7-4e60-b198-7383910b8213 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.728591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.729560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.729909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.730286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.743186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.744669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:09.765185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:09.766229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:09.767339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:09.767339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:09.767339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:09.767339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:09.767339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 345/691] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:09.771986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:09.890979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c924b2-883c-4936-9d01-c69cdd4b51e7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:09.928418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:09.929142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:09.929429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:09.929705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:09.930477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:09.930782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:09.932146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:09.945210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 347/692] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:09.950705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:10.060425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:10.065148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0969e-77c6-4304-a512-d6e47a65b365 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:10.109749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:10.110953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.111726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.111890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.130141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:10.130141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-372928a2-8932-4b44-b2d2-1264718c4895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:10.150995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:10.152181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:10.153141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:10.159853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 346/693] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:10.165251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:10.192226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:10.271824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837ba-1e16-4e77-a8ea-10786e273522 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:10.276573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f2fd-ca3f-4e9c-804d-512cc4f7c2d1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.276960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f2fd-ca3f-4e9c-804d-512cc4f7c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.277353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f2fd-ca3f-4e9c-804d-512cc4f7c2d1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.280838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 347/694] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:10.286175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.286640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.287094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.305143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:10.306862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:10.331255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:10.331920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.332208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.332486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.333279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:10.333590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:10.335302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:10.355365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 348/695] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:10.362854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:10.385864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 348/696] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:44:10.413532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:10.517202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:10.543059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5cf7-56e9-45ca-8048-427aff70ae3c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:10.580894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:10.583059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:10.583730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.584013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.584294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.586080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=e317b8e3c61b456281c6f99da6c7a77b) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:10.586431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:10.588427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:10.595639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 349/697] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:10 2022] GET /identity/v3/role_assignments?user.id=e317b8e3c61b456281c6f99da6c7a77b&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:10.616190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627076-e7a9-4f22-8920-8c5bc98fcea3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:10.680749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:10.681481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.681764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.682041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.699512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:10.707746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:10.708684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:10.709546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 349/698] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:10.717613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:10.835626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79fc1-64bf-4ade-afd0-9b5bb5388cd1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:10.884576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:10.885249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:10.885532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:10.885809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:10.886649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:10.886955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:10.888841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:10.897661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 350/699] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:10.903570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.007881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53c26-12a2-4562-887c-796681ce4635 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.049035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.049841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.050136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.050433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.064584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.066041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.075604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7367ce19-0659-42c0-ac47-b1b527b5e1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:11.085719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:11.086681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:11.088250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:11.088250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:11.088250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:11.088250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:11.088250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 350/700] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:11.092870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.110640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:11.165165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931b7c-a02e-4393-a51a-1a621527d13b None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.165801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931b7c-a02e-4393-a51a-1a621527d13b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.165981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931b7c-a02e-4393-a51a-1a621527d13b None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.167669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 351/701] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:11.172330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.172621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.172949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.201329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:11.202554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:11.217204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd248-1919-4a5b-bae7-154c801ee948 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.252149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.253237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.253779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.254298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.255225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:11.255732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.257302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.271200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 351/702] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:11.283307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.310618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 352/703] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:44:11.332943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.423379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:11.485510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0e214-6b02-4e58-8ee2-3f658b17a8b9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.489764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a281b7-42dc-4374-81c8-523bdd808108 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.545556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:11.551925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.553023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.553982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.554457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.555428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.555850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.556270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.557233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.558041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.561026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.570890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.572838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:11.584677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:11.585924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:11.586985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:11.594630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 353/704] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:11.603878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:11.604046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:11.604923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:11.605846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:11.609717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 352/705] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:11.610840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.720897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb887-4730-41e5-a488-a500ee113fc0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.755212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:11.758939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.759623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.759991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.760696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.761739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:11.762730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.764445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.788169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 353/706] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:11.789533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.896131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf222f-c8e4-454b-afdd-da82023fb1fc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.901134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844320-d9cb-4fa8-9c85-7d61d045b400 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.940708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.941646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.941934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.942241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.983380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.984340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.984787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.985213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.986071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:11.986544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.988072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.008044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 354/707] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:12.008272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.014178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.020284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.021787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.098928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.166470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbc605-3028-4ad2-9f56-9bb68900bddd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.204114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.204785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.205072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.205349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.206057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:12.206391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.207756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c0f57-eebc-41c1-bb9f-4410bd41629a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.213914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 355/708] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:12.215204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc947-1e56-47b5-9db5-64d02f7a1896 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.215495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc947-1e56-47b5-9db5-64d02f7a1896 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.215781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc947-1e56-47b5-9db5-64d02f7a1896 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.217218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 356/709] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:12.221502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 354/710] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:44:12.226236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9791e-9cb0-4d34-9601-418d08423d07 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.226236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9791e-9cb0-4d34-9601-418d08423d07 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.226236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9791e-9cb0-4d34-9601-418d08423d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.227794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.267827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-02c9791e-9cb0-4d34-9601-418d08423d07 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:12.269667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-02c9791e-9cb0-4d34-9601-418d08423d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:12.353844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 357/711] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 08:44:12.355655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f5e4-79e6-4840-8d2d-683b98b6b55c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.356707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f5e4-79e6-4840-8d2d-683b98b6b55c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.357185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f5e4-79e6-4840-8d2d-683b98b6b55c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.358732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 358/712] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:12.365139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.365835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.366350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.370663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.387064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:12.388586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:12.390150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bba86-ea0e-4cbf-822f-c5cf784b91a8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.443412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.444335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.446318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.446760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.447241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.462891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.464879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.468376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 359/713] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:12.469316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:12.489351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:12.490510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:12.491624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:12.491624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:12.491624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:12.491624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:12.493511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 355/714] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:12.498954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.600014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f320ecd-9232-46c1-98ca-fd9a7a255396 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.603943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97e7d-9788-43a5-87da-0ccb5669bf62 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.638743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.639537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.639814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.640082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.647537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.648822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.649317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.649820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.651018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:12.651276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:12.651783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.653898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:12.659652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:12.660652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:12.661505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:12.666135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.666851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 360/715] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:12.667797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.671094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 356/716] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:12.672530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.716920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.784820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d742e-0bbf-4dbc-9edb-fdaa2f6c2b11 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.811715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f2bd3-6eff-41df-858f-4b13297964a4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.821900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.822751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.823028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.823300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] PATH_INFO: `/v3/services/network` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.823946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.825447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:12.838290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:12.839261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:12.840131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 361/717] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:12.841494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.861220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:12.862545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:12.863050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:12.863972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:12.864966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:12.865489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:12.867649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:12.879946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 357/718] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:12.881121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:12.958221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc547fa2-6698-4574-9cb2-90c64c840e64 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:12.961947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:12.969118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.000791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.001643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.001921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.002270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.009768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.011349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.019057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0799-ed77-4a73-9130-69697d91ca7b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:13.026459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:13.027373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:13.028840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 362/719] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:13.029362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.065637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.067869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.068380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.068872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.069815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] RBAC: Adding query filter params (name=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.070359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.072441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.080083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 358/720] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:13.081431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.145586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a3bb-ee4a-4111-a0ea-7657a45e1681 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.181744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.183044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.183044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.183248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.196364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.197990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:13.217520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:13.218517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:13.219467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:13.219467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:13.219467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:13.219467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:13.223318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 363/721] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:13.224265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.228840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342074a5-e489-4bbd-bb38-5f72a7671006 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.245041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.261837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.277379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.278092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.278447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.278667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.279452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.279759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.281289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.296177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 359/722] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:13.297096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.338003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7bc1-b01b-4863-9d04-080660a2ab1a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.376248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.377035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.377500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.377946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.378831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.379308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.380828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.386321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 364/723] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:13.387291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.409474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc51b0-a682-4cc1-a7f8-217ed2716821 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.448305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.449346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.449885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.450376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.451300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.451864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.453446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c89d8-2587-4277-835b-2fefb6de9b2b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.471881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 360/724] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:13.473645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f8894-3e25-408b-9f2d-737035ab5974 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.474097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f8894-3e25-408b-9f2d-737035ab5974 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.474590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f8894-3e25-408b-9f2d-737035ab5974 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.476566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 361/725] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:13.477546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f8894-3e25-408b-9f2d-737035ab5974 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.502604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.525198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c000c4-eba1-4c85-b9b8-874de94e85d2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.546397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.572813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.573858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.574384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.574895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.575888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.576209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.577637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea004-b38c-4ae9-b05b-a257e0b7fd15 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.584122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 365/726] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:13.585500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.585792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.586072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.604765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:13.607544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:13.629744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f8894-3e25-408b-9f2d-737035ab5974 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.702760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.703595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.703879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.704150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.722208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.725047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:13.731750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 366/727] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:13.745371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:13.746325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:13.747519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 362/728] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:13.755339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.772588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:13.873917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.908955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fcf8b-02dc-4508-9ae5-a124e866432a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.936563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88cc7-9d5b-46ce-a759-2994a9501480 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:13.943151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:13.983539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:13.984139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:13.984423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:13.984698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:13.985548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:13.985856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:13.987306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.006834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.007654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.007938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.008214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.011444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 367/729] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:14.016997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.043020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:14.059647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:14.060608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:14.061425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 363/730] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:14.071073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.126945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ce8e-c7e8-4a19-b473-f5c23d0656da None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.165157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.166942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.167468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.167941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.171083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.250393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ffc8-3d14-4f6f-8e39-f0da347851af None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.288865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.289999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.291419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.292041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.293677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:14.295516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.297394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.315421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.317203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8f20c-518b-4751-afbc-276ce43ba66b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.321829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 364/731] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:14.325393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.358009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.431693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 368/732] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 08:44:14.433021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84962-4fc9-4f50-8a4f-2c287061b35f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.433316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84962-4fc9-4f50-8a4f-2c287061b35f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.433594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84962-4fc9-4f50-8a4f-2c287061b35f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.436076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 369/733] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:14.436998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee84962-4fc9-4f50-8a4f-2c287061b35f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.441914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173e3cc-fbb9-4e3c-9705-4d95849afccd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.475526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.475727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.477568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.477788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.478336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.492541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.494988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0d607f15-8f7d-49e5-9773-79490627f306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:14.514507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:14.515578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:14.516622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:14.516622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:14.516622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:14.516622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:14.517951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 365/734] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:14.519417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.519773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.520123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.537539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:14.538886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:14.551417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee84962-4fc9-4f50-8a4f-2c287061b35f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.587166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.588224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.588686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.589158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.600184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.602036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.618249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 366/735] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:14.618249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.623973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:14.634130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:14.635014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:14.635909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:14.635909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:14.635909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:14.635909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:14.635909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 370/736] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:14.643040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.716424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b133e-e9da-4017-be73-bee080961cef None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.750748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.751617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.751908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.752189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.752912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:14.753224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.754621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.755374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.766783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 367/737] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:14.767510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.769219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67d17-f6c3-4f05-9e82-58f013e05e4d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.809571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.810376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.810672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.810951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.811670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:14.811980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.813464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.826862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 371/738] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:14.827747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:14.846723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:14.891838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045bbb-5e08-41a2-8d9b-1b2a97f057a7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.935607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:14.936612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:14.937233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:14.938083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:14.939337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:14.941341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:14.959509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132f00-374f-4a1c-91ac-079834e68177 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:14.960751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 368/739] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:14 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:14.963021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.012367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.015185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.015546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.015898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.026390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.029295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:15.051313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:15.052308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:15.053586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 372/740] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:15.058736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.064007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:15.112977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79e60b-6d31-48b7-93a4-dbf04e83e6cc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:15.172249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:15.189456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.190342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.190633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.190957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.206931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.209212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:15.231189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:15.232303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:15.233394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:15.236273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 369/741] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:15.239558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e0b22-ccf2-4a59-9ed7-18803d9f79d4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:15.240990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.277549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.278759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.279056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.279351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.280198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:15.280683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.282077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.302334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 373/742] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:44:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:15.307317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.380388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d444b-9cad-4cf0-b391-7ef53e594a24 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:15.393269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:15.421268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.422317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.422812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.424113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.425115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:15.425626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.427307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.441160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 370/743] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:15.447244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.481429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651875d-d0a8-41f0-8787-170f418627cc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:15.532494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:15.654701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.655360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.655640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.655910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.674894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c518a4-d855-48ad-bb35-c17574416b5d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:15.743715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:15.744460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.744645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.744911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.745733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=123e880f189146e4bae93a06a981fbd8) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:15.746036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.750989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915a341-0bca-44f3-84cd-0548259c8a50 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.768517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 371/744] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:15 2022] GET /identity/v3/role_assignments?user.id=123e880f189146e4bae93a06a981fbd8&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:15.780086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:15.781558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:15.856446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feceb1a-8bb3-4afb-bb04-15ce7ecf3a24 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.856756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feceb1a-8bb3-4afb-bb04-15ce7ecf3a24 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.857052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feceb1a-8bb3-4afb-bb04-15ce7ecf3a24 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.858878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 372/745] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:15.860091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:15.867745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871cb6-3f62-4288-997c-1e30129e589b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:15.868176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871cb6-3f62-4288-997c-1e30129e589b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:15.868492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871cb6-3f62-4288-997c-1e30129e589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:15.909151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 374/746] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 08:44:15.915374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:15.920235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-53871cb6-3f62-4288-997c-1e30129e589b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:15.921143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-53871cb6-3f62-4288-997c-1e30129e589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:16.030132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 373/747] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:16.030731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8040f-7e82-41d8-9f3a-ccbc62566851 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.031484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8710-388f-402b-9f18-6b5f8269ab19 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.031776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8710-388f-402b-9f18-6b5f8269ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.032055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8710-388f-402b-9f18-6b5f8269ab19 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.038009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 374/748] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:16.039241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.039530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.039812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.056908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:16.058104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:16.073940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.075372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.075855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.076451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.089711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.091743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.095178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:16.114105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:16.114997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:16.115880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:16.115880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:16.115880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:16.115880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:16.118731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 375/749] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:16.124392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.143101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.151025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 375/750] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 08:44:16.152023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.248519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c6d7-dcf2-442b-bd02-1f6a390d58b2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.272584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50bd8-6e0a-4cd0-9032-140e5c6680b7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.292892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.294483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.295509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.296018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.297216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.299742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.310904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.311638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.311924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.312236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.312976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:16.313363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.314780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.320176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 376/751] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:16 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:16.321359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.332461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 376/752] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:16.335185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.403184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.467719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5445-9988-4438-8c03-37f2da910f7b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.496232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.524905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.526421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.526855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.527508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.536709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1247-90a2-4633-b00a-f04af2f1e7a4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.537835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.540692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:16.560171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:16.561280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:16.562383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:16.564973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 377/753] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:16.570878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.581761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.582729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.583667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.584047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.598425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:16.610407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:16.611351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:16.612221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 377/754] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:16.619064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.691329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.717545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94524f-ff8c-4310-bcfc-25c8201ae0d9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.758630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575bfe-d9b1-4bec-8926-315e9c764899 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:16.793633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:16.801999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.802713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.803004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.803285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.804041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:16.804351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.805723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.809167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:16.809834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:16.810136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:16.810415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:16.811206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:16.811514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:16.812942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:16.828305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 378/755] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:16.837451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 378/756] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:16.839105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.843906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:16.990994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5952-c451-4182-9ad3-9292f3aa6817 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.028081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21416-643d-4807-af8a-85d9accc1c93 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.049553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.050256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.050539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.050813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.051651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=e317b8e3c61b456281c6f99da6c7a77b) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:17.051963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.053408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.066567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 379/757] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/role_assignments?user.id=e317b8e3c61b456281c6f99da6c7a77b&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:17.077213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.078048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.078424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.078706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.091159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.092632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:17.123981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:17.124935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:17.126254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:17.126254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:17.126254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:17.126254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:17.126254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 379/758] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:17.131108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:17.153204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:17.281487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25215-95ed-4356-ac0f-59d19f58b7ed None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.325718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.326806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.327319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.327806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.328754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:17.329263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.331180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552073-0324-49a0-ab97-f297e1a40055 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.348441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 380/759] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:17.353735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:17.363605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcda3-3a99-4200-8663-7ee750ab61a3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.363907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcda3-3a99-4200-8663-7ee750ab61a3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.364178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcda3-3a99-4200-8663-7ee750ab61a3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.365699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 381/760] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:17.370991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.372161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.372673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.389209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:17.390712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:17.459101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:17.489874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 382/761] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:17.536626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:17.550472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:17.557972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84738b-e46c-4239-b721-509243b5f583 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.622895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.624077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.624555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.625021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.635756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.639301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:17.660267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:17.661220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:17.662139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:17.671533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 380/762] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:17.678196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:17.712085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a2f6-3220-45e7-98e4-45a6869582ae None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.774793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.775975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.776630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.778419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.779870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.781593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:17.801518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:17.802487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:17.803310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:17.807671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:17.814361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:17.866733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44952b5-d973-4a48-8426-a2fe17f34383 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:17.884408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:17.937843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:17.939198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:17.939680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:17.940146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:17.941294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:17.941826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:17.943459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:17.957185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:17.963449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 381/764] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:17.969342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.036098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9832-d55f-4e98-af99-ce0c0bd3910b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.095386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.095990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.096277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.096560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.097268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:18.097605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.099216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.104973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 384/765] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:18.115245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.185898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970bf8-d1fb-499b-8dd3-b133e3e0a586 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.225402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.227006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.227747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.228228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.238551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b183-7b87-4229-bf1d-44515a7138f2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.243037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.244685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.268193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2322e0ac-6797-45e7-a749-58616a6e66cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:18.270876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:18.276702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 382/766] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49968b39-f84c-4e22-985e-94db601ea573 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49968b39-f84c-4e22-985e-94db601ea573 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.278238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49968b39-f84c-4e22-985e-94db601ea573 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.278784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.278875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 383/767] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:18.278944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.278944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.278944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.280243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49968b39-f84c-4e22-985e-94db601ea573 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.282776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:18.283098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.284538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c616f4-3a9e-4e8f-884f-886071c01de4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.291612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 385/768] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:18.292916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.293253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.293531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.301559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.310903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:18.312175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:18.394368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 386/769] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:18.395519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.427249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49968b39-f84c-4e22-985e-94db601ea573 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.462464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.463130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.463414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.463691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.464636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:18.464874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.466882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.478717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 384/770] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:18.479488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.519373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d5e73-119f-4b38-a211-f0ac198fac01 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.551047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.558527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.565860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.566837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.567217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.567525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.568658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] RBAC: Adding query filter params (interface=public, service_id=6d712739ccdf477888e66f15b72deebb, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:18.569034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.570939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.581547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 387/771] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/endpoints?service_id=6d712739ccdf477888e66f15b72deebb&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:18.582661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.587152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332ca51-e3b4-4cc8-8b7f-089a96272202 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.622030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.623297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.623763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.624218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.635427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:18.645585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:18.646548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:18.647391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:18.654822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 385/772] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:18.655908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.705187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6d6-62c3-4adf-84fd-a20a7d6f3855 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.741705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.742651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.743064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.743339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.750925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.752464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.766521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdace7-d07c-4501-ad93-413848580947 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:18.767458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:18.768317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:18.769178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 388/773] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:18.770273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.805399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.806474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.806989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.807459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.808315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.810536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.812640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.817521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 386/774] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:18.818743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.823077 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:18.883510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b4ea-09ca-4414-a103-428cea1aa8d9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:18.922371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:18.923461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.923950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.924424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.925415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:18.925953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:18.927602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3d396-8d55-47f1-ac5b-90a3154a6eab None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:18.942716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 389/775] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:18.944609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cc8e-c6af-472e-b0bd-2872d7428fad None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:18.945113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cc8e-c6af-472e-b0bd-2872d7428fad None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:18.945614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cc8e-c6af-472e-b0bd-2872d7428fad None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:18.947565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 390/776] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:18.948593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cc8e-c6af-472e-b0bd-2872d7428fad None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:18.963683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92403c-07c5-404a-8d57-1df9860be911 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.004405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.005624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.006129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.006704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.007307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:19.007620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.009136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a3c7-e47b-4d0e-8e9e-f3ab58abbc29 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.023119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 387/777] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:19.024505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.024794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.025073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.047596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:19.048793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:19.075304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cc8e-c6af-472e-b0bd-2872d7428fad None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.087146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.115934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.116745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.117071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.117348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.118158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.134137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.134325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 388/778] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:19.134438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.138635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:19.177667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:19.178616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:19.179566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:19.179566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:19.179566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:19.179566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:19.180124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 391/779] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:19.181193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.249507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56b2ea-9e2a-4f4f-9890-606c0a380d8c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.293866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.295043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.295399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.296077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.298819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=f847d12027be4164aff8449a2bd42750, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.300500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.304942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488a29-2000-404c-b4dc-bb13165587ce None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.315593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 389/780] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:19 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:19.316624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.353371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.354697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.355304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.355788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] PATH_INFO: `/v3/services/network` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.357276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.359071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0b31650a-af64-4fd1-b2a0-e705dfd3f911 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:19.373687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:19.374999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:19.376025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:19.377074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.378944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 392/781] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:19.380591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fdea1-28a7-481f-baec-2a210eb7d016 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.381093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fdea1-28a7-481f-baec-2a210eb7d016 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.381603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fdea1-28a7-481f-baec-2a210eb7d016 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.383299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 393/782] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:19.384820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fdea1-28a7-481f-baec-2a210eb7d016 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.426589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.440962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22cff-f536-4d38-81ec-9362458ab3ca None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.479955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.481433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.481737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.482082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.483438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:19.483438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.486296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e68d0-d7dd-4da8-bd78-b9b1b54c3edb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.500230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 390/783] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:19.501527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.501818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.502137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.519279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:19.520977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:19.526816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fdea1-28a7-481f-baec-2a210eb7d016 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.576443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.577261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.577649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.578074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.578859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:19.579449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.580820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.590618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 394/784] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:19.590618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.603668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 391/785] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:19.604854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.657089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.710260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.722418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ccd61-7fec-4002-a49e-99806554dc61 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.722565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab51a3-e3ea-469f-8a60-2dc7c1fc8cd5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.757839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.759215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.759721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.760201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.768507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.769127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.769251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.769447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.769725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.770445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] RBAC: Adding query filter params (type=network) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:19.770748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.771733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.772083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.782187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 392/786] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:19.783280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:19.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:19.794076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:19.795046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:19.797660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 395/787] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:19.798678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.899402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3353e5-1a59-4e91-8de7-b89a6b146e32 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.924504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0176d-997a-4fe8-9279-234b4b3f8c66 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:19.933983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.934857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.935147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.935426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.938478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:19.949147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:19.959462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:19.960429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:19.961275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:19.966135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:19.966135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:19.966135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:19.966135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:19.966464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] RBAC: Adding query filter params (interface=public, service_id=c395689bde734c18bb267ddbd8dcea9c, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:19.966534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 393/788] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:19.966603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:19.967166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.968116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:19.976723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 396/789] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/endpoints?service_id=c395689bde734c18bb267ddbd8dcea9c&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:19.977557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:19.995141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.074037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ee18-af47-4856-9f9f-ed473d7aae23 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.089010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b4384-b019-473b-af7d-7aa4730f8aa0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.109593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.110299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.110583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.110866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.111738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:20.112004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.113422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.127694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.128618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.129051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.129474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.130410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:20.130864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.136485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 394/790] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:20.136485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.137924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.150256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 397/791] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:20.151382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.168394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.232197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.245911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468ede-2693-45a7-ab7b-9cf155df8a14 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.256860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16dfaa-64c6-4d6e-8cf0-0528217f38a0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.282141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.283089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.283593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.284063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.284922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.286513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.292386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 395/792] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:20.293478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.294176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.295243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.295731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.296200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.326962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.328847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:20.370325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:20.371391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:20.372782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:20.372782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:20.372782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:20.372782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:20.383630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 398/793] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:20.389468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.453767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.482140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db170-f6e8-465d-acc4-f12f22e1df9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.520425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.521234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.521508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.521781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.532382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.533816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.546610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53621d-96ea-44c5-a826-310005d91575 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:20.555256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:20.556232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:20.557144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:20.557144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:20.557144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:20.557144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:20.557144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 396/794] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:20.563160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.586712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.599464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.600728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.601223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.601732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.602979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:20.603514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.606606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.623425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 399/795] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:20.631407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.677033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084dc9-dcfc-47fd-8a75-7bb17a4a6dda None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.711537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.712199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.712480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.712753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.713461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:20.713764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.715704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.722592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.730427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 397/796] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:20.734943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.782384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e489-e127-4322-8cb3-32b1fe7f3e58 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.817725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.818551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.818834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.819113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.826049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.827528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:20.842501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:20.843467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:20.844332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:20.848457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 400/797] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:20.849631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:20.901135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:20.904735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8b95-e102-4641-944f-22c0188dec82 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:20.964066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:20.965935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:20.967434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:20.968104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:20.981979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:20.985160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:20.989328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b843-ebbe-4984-8597-20123acfaebb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-002e526d-e681-49a0-96e0-8e61d0c17993 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:21.012189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:21.013187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:21.014227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:21.016187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 398/798] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:21.017824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725523a-fe42-4ab0-b7ed-f93779127165 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.018282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725523a-fe42-4ab0-b7ed-f93779127165 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.018720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725523a-fe42-4ab0-b7ed-f93779127165 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.020436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 399/799] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:21.021638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725523a-fe42-4ab0-b7ed-f93779127165 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.040731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.041451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.041833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.042216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.043078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:21.044006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.045503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724a6d-95d0-453b-9a24-dbff00a13464 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.058381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 401/800] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:21.059783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dac71-11d6-434c-b13e-8f706014583a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.060157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dac71-11d6-434c-b13e-8f706014583a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.060506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dac71-11d6-434c-b13e-8f706014583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.078324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-812dac71-11d6-434c-b13e-8f706014583a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:21.079621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-812dac71-11d6-434c-b13e-8f706014583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:21.087393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.141802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725523a-fe42-4ab0-b7ed-f93779127165 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.172365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 402/801] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:21.173203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dac71-11d6-434c-b13e-8f706014583a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.197993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.198850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.199309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.200110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.200958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:21.201268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.202840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.218049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.233218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 400/802] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:21.234168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.296018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dac71-11d6-434c-b13e-8f706014583a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.332118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.333086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.333372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.333655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/123e880f189146e4bae93a06a981fbd8/roles/93233f8df513407186508b6223a04630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.349865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=123e880f189146e4bae93a06a981fbd8, role_id=93233f8df513407186508b6223a04630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.351373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.356771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c43ea3-46b8-4cc5-9c16-3e99d6042795 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.368707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 403/803] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:21 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/123e880f189146e4bae93a06a981fbd8/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:21.369895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.375458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.422325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.423175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.423458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.423737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.424674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.425961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:21.453816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:21.455294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:21.456151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 401/804] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:21.463391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.488769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.503618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3c76-e944-44e7-a53f-98dcf592a3e6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.549321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.550045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.550415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.550701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.567567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.569670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:21.592586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:21.593716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:21.594859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:21.594859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:21.594859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:21.594859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:21.594859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 404/805] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:21.601842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.620185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ff28-0f98-4360-98e8-78d3be0540fa None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.656481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.657255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.657615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.657976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.658787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:21.659169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.660602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.666168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 402/806] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:21.671644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.717592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e425930-7b21-4b53-ad41-4d9c0343bab2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.722042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.754551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.755398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.755531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.755769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.756492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:21.756799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.758223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db83c89-0de4-42a0-bf30-022f4df25498 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.767634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.771758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 405/807] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:21.772740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348932d-4ec5-4087-bc6f-8941fd0b23f5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.773028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348932d-4ec5-4087-bc6f-8941fd0b23f5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.773309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348932d-4ec5-4087-bc6f-8941fd0b23f5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.779444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 406/808] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:21.780770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348932d-4ec5-4087-bc6f-8941fd0b23f5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.786860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691b2-c68a-4ce1-aeb8-1835216b2c16 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.826497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.827410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.827886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.828310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.829238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:21.829712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.831439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41405f9-7d4a-4dc3-92cb-4c3eeaff492e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.837536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 403/809] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:21.839077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.839510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.839958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.862385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:21.863817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:21.914347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348932d-4ec5-4087-bc6f-8941fd0b23f5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:21.931576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 404/810] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:21.932745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:21.958186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:21.958186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:21.958186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:21.958734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:21.967835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:21.970174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:21.981561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:21.988045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:21.989148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:21.990798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:21.995728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 407/811] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:21.996823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.056886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240710dd-83d6-421a-90c0-b52e41f7aff0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.062934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:22.093313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.094231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.094669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.095112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.095853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.097229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.108489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8796-7432-4b1f-96c1-dc30288b701e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.124104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 405/812] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:22.127266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.180569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.181654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.182091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.182537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.211884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:22.228023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:22.229211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:22.230265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:22.237827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:22.238081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 408/813] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:22.243883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.245398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d688dc-4c41-4428-8b97-3913f61dd32d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.286740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.287586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.287942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.288287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.289150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:22.290797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.291354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.304650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 406/814] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:22.311616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.394206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994de34-8767-4b11-b7ca-2334bc75ce21 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.415674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:22.431363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96fef4-ec48-4c1b-a98e-7c835d79c038 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.440385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.441613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.441905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.442249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.443012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:22.443795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.445628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.456993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 409/815] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:22.462251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.476887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.477793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.478079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.478470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/e317b8e3c61b456281c6f99da6c7a77b/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.480824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=e317b8e3c61b456281c6f99da6c7a77b, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.482400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.498941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 407/816] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:22 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/e317b8e3c61b456281c6f99da6c7a77b/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:22.575651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55985-4df8-414e-8d8b-68ad72f75751 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.614225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.615357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.615815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.616304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.629240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.631197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-558f5660-9255-44c9-a0e5-fc9e6d594a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:22.650391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:22.651337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:22.652225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:22.652225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:22.652225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:22.652225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:22.654389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 410/817] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:22.662262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.685172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:22.764852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8daf7-1ea3-46ea-90c9-8f8037524273 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.765132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8daf7-1ea3-46ea-90c9-8f8037524273 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.765393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8daf7-1ea3-46ea-90c9-8f8037524273 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.767049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 411/818] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:22.772442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.772731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.773007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.781759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3cba6-380c-46ea-832c-a0899a8a2229 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:22.794184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:22.795666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:22.827967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:22.829224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:22.829522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:22.829803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:22.830706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:22.830838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:22.831022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:22.832724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:22.860994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 408/819] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:22.867232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.905891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 412/820] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:22.948423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:22.986601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:23.025034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745e2f-c3d7-4614-a90c-a73f013f2e94 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.084795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.085886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.086190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.086477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.101389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.102872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.105098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0801e-1235-4d8b-bc9c-3d85f851c57a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:23.130191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:23.131238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:23.132149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:23.137149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 409/821] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:23.142526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:23.161311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.162429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.162968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.163465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.164929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.167198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:23.186003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:23.187040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:44:23.187876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:23.194051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 413/822] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:22 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:23.196198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:23.250476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:23.350885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1f7c-fd3f-4b92-8ee7-a87c4e581bc2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.389039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.389976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.390402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.390788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.391601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:23.392017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.392363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee522d6-563a-4b1b-84fb-f7bb3928fcb4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.393591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.398743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 414/823] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:23.404387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:23.471468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.472077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.472365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.472645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.473485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:23.473798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.475256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.476955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:23.498260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:23.510959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc850f-c45a-4a4d-b67c-47087e3b7cd0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.511743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 410/824] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:23.513323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:23.562573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.564221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.564869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.567135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.568055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:23.568763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.572120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.590689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 415/825] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:23.594098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:23.713461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897228a-7d4e-4360-bfac-21c05641f61a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.784636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.785702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.787240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.788411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.791651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1109-df65-40d6-826b-7e34d4c344ae None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:23.861963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:23.864699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:23.867892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:23.868411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:23.869430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.871690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:23.909571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:23.910515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 416/826] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:23.928137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:23.929999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.041958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 411/827] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:24.047120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.062617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.169274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e170e7d-3823-48a1-989a-57724e8903c8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.205169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.205986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.206304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.206583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.217985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.219479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2543ef0d-3699-435c-a4ea-8cce771dda1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:24.237667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:24.238606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:24.239483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:24.239483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:24.239483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:24.239483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:24.239483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 417/828] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:24.244460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.255885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b249-02b1-45d1-90ea-b28eb3dbb518 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.256179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b249-02b1-45d1-90ea-b28eb3dbb518 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.256480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b249-02b1-45d1-90ea-b28eb3dbb518 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.258248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 418/829] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:24.264747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.265037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.265318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.282342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:24.283569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:24.350579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.370588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.370846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 419/830] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:24.377121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea251ce-5737-4474-b0dc-c9ab67c68a15 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.392195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.418918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.420014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.420313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.420597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.421608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:24.421922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.424032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.439858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 412/831] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:24.446213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.507137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f02b68-17d5-4cce-bc83-312cdb478991 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.545492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.546368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.546624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.546896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.557623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:24.565794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:24.566840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:24.567678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 420/832] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:24.573045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.579390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584836f6-a6c3-4500-ad39-0239f055c0d8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.618185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.619372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.619866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.620366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.628677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.630578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:24.646578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:24.647516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:24.648403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:24.651054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 413/833] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:24.659163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.676167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.743895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.771571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e952881-3fd6-4733-9b37-77bc008d03c3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.802839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76e41-c164-4113-a4df-f8dd13de22ce None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.809085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.809761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.810044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.810345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.811129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:24.811434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.812868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4781-1ad3-4c5f-92db-aa168f468cc8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.826029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 414/834] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:24.827401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99605b9-4479-40b9-9225-55308e2e5c06 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.827700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99605b9-4479-40b9-9225-55308e2e5c06 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.827982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99605b9-4479-40b9-9225-55308e2e5c06 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.829383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 415/835] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:24.832399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99605b9-4479-40b9-9225-55308e2e5c06 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.844674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.845446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.845611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.845892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.846670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:24.846976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.848343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc16bd-8a9b-498c-9808-0163158fbc6d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.857561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 421/836] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:24.858777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804a22-072d-4743-a12a-4826665a0383 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.859065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804a22-072d-4743-a12a-4826665a0383 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.859340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804a22-072d-4743-a12a-4826665a0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.875320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0f804a22-072d-4743-a12a-4826665a0383 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:24.876446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0f804a22-072d-4743-a12a-4826665a0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:24.909028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:24.939392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99605b9-4479-40b9-9225-55308e2e5c06 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:24.940432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 422/837] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:24.941590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c539aa-7cab-4890-9cc5-55c36b9d2e62 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.941885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c539aa-7cab-4890-9cc5-55c36b9d2e62 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.942175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c539aa-7cab-4890-9cc5-55c36b9d2e62 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.943420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 423/838] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:24.944098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c539aa-7cab-4890-9cc5-55c36b9d2e62 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:24.977835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:24.978622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.978901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.979180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.980006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:24.980532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:24.981731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b96d3-14bd-4dbe-b651-643b83d14e7d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:24.987496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 416/839] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:24.988703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:24.988995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:24.989272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:24.990222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.007087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:25.008476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:25.066435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c539aa-7cab-4890-9cc5-55c36b9d2e62 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.098644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 417/840] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:25.099997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.111469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.111778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.112061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.112335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.124574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.126181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:25.146579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:25.147504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:25.148414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:25.148414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:25.148414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:25.148414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:25.148414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 424/841] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:25.148692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.181701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.222539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d901c7-a5bb-4502-ace8-6e62bfd99ff3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.251461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.261314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.261720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73b630-e6d3-4e69-8166-09e26c5e7916 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.262765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.263050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.263329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.264013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.265423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:25.277438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:25.278513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:25.279360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 418/842] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:25.280858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.303321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.304110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.304391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.304660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.315618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:25.323443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:25.324991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:25.325809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 425/843] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:25.327285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.386094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da416-a0ce-432f-8b61-af63fed305aa None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.420823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.428564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.429551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.429846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.430142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.430881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:25.431195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.432567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.438485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553614f-5ca6-463c-b95a-b951c8333058 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.445109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 419/844] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:25.445920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.478742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.479642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.480104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.480558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.481508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:25.481813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.483315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.487920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 426/845] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:25.488891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.506968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.553908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac091a-e23d-4eac-90a5-b20b2db3d388 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.591488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.592893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.593200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.593474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.594238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:25.594546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.595901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.596785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471684ff-7e8b-4312-a50e-6d95d322dada None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.609074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 420/846] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:25.609074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.636876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.637929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.638399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.638678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.646570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.648010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:25.662588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:25.663770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:25.664723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:25.665252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.665583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 427/847] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:25.666033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.721999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e9bf-d903-4580-a05b-eccbea9887b4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.748026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.758143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.758816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.759101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.759379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.760077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:25.760378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.761756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.766686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 421/848] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:25.767276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.784908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40954-5ca3-4a94-a850-f7c2871c9b50 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.832536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.833369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.833655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.833935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.850246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.852662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:25.878156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:25.879087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:25.879977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:25.879977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:25.879977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:25.879977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:25.882273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 428/849] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:25.886553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:25.900893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df38-b6f1-4813-8c93-1711a294085c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:25.923989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:25.953776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:25.954503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.954794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.955075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.955917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:25.956233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:25.957665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:25.982156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 422/850] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:25.987370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.020168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b13c6-71ca-41af-a871-e9b5a8fec467 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.052330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.063234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.063901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.064360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.064662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.065703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:26.066263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.067876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.086027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 429/851] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:26.095397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.101956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068990f9-5db2-4f23-8c64-92d3d3027957 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.146725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.147389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.147672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.147949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.207154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.209546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49801-13ab-414d-b7c2-410d74019a1d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.243889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.244079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.244823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.245105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.245379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.246820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.252806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.254278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:26.269589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:26.270604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:44:26.271542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:26.275733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 430/852] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:26.276571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.326482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.376895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418fe-c251-4145-95eb-822c91d4d412 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.381046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 423/853] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:26.390679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.418321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.419366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.420043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.420516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.421987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:26.422531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.425281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.462277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 431/854] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:26.463612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.521855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.573016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc611-d0a4-427f-9a04-3ecdaa7736e6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.626403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8cb3-c5d2-4948-b11a-0072e344e7e0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.635904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.644226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.646096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.646652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.647476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.662781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.665677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.672249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.672898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.673175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.673446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:26.689559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:26.690502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:26.691371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:26.691371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:26.691371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:26.691371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:26.696513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 424/855] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:26.696997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.751732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.753223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.830757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0353d0d-1664-4921-9b78-eed07a7dd312 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.856614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.866830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.867508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.867787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.868062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.868782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:26.869085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.870463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.877103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 432/856] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:44:26.882918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.884098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 425/857] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:26.890137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.892241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:26.995686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1dfa5-ce09-4766-bcfb-64f14b8c705e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.031166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb75f2-8b2e-4c7d-86b2-04f2e7f6782d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.036442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.037485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.037966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.038459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.053129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.055210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.066275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.067067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.067346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.067616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.075164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.076674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6e06cec5-a841-4c81-bfb9-0a1aff906e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:27.082690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:27.083794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 433/858] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e584ee-55d0-47cf-9c25-49a357d7f2c3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e584ee-55d0-47cf-9c25-49a357d7f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e584ee-55d0-47cf-9c25-49a357d7f2c3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.089399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 434/859] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:27.089943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e584ee-55d0-47cf-9c25-49a357d7f2c3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ac14f23d-7673-49ca-866b-b38b981ef7af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:27.097311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:27.098173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:27.099091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:27.099535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 426/860] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:27.100458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.100746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.101023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.119301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:27.120497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:27.157671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.171260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.202521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 427/861] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:27.203320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.214014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e584ee-55d0-47cf-9c25-49a357d7f2c3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.253266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.254856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.255340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.255835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.256754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.257335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.258801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.271491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 435/862] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.276486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.307046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923f8b-3d65-41c6-8a60-89d24fe38031 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.343514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.344182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.344465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.344742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.345519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.345824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.347280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.361398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 428/863] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.362049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.387699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7255d6-48aa-48b3-9ce3-ee040cb4d86a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.403957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.406207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.424537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.425348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.425624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.426204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.426576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.427926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:27.441159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:27.442140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:27.442996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 436/864] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:27.443823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.483166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db857-e0bf-40a1-9262-bc4d2c3a1d32 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.518571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.519375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.519659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.519936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.528247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.529723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:27.545308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:27.546312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 429/865] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:27.552124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.556816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a78a3-1515-45c8-9cba-5d6c44929a89 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.592292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.592892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.593177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.593455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.594310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=123e880f189146e4bae93a06a981fbd8) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.594621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.596044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.602074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 437/866] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/role_assignments?user.id=123e880f189146e4bae93a06a981fbd8&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.603166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.655645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.682381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.693034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fb4e-cacf-4b3b-a24c-0cce94deedc6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.721686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdc626-41cb-48fa-a12b-af3ff4f03f5c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.742223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.743204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.743638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.744081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.745550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.746371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.748132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.759848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 430/867] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.761512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.774160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.774160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.774160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.774160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.774603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.774603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.774603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.787200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 438/868] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.793996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.894530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d97d6-54eb-4bd3-a1cf-5b30ae03b9f7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.924511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fafb-6175-4868-aadb-ed923aa93f0e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.926876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:27.930936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.931590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.931873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.932153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.933285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.933624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.935394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f4ebf-ff24-4100-bc95-648930b01bd7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.941379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 431/869] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:27.943449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb254-cf19-47cf-8cd4-2be94e440a6c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.943735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb254-cf19-47cf-8cd4-2be94e440a6c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.944015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb254-cf19-47cf-8cd4-2be94e440a6c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.945616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 432/870] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:27.954302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932bc1-6847-4b88-9feb-9e9d93951d6d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.954886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932bc1-6847-4b88-9feb-9e9d93951d6d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.955344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932bc1-6847-4b88-9feb-9e9d93951d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.969701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.970737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.970883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.971057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.971970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=e317b8e3c61b456281c6f99da6c7a77b) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:27.972285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.973841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.978856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-de932bc1-6847-4b88-9feb-9e9d93951d6d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:27.980391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de932bc1-6847-4b88-9feb-9e9d93951d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:27.981213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 439/871] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:27 2022] GET /identity/v3/role_assignments?user.id=e317b8e3c61b456281c6f99da6c7a77b&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:28.002544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:28.063534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 433/872] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:28.087666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.209059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347abd-7b40-4611-9f17-2263ad13a81a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.244797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.245468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.245748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.246019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.247313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.248732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad30d-ac1d-4627-828e-8aac46f0e0b7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.266880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 440/873] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:28 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:29.775392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40457c-7c84-4011-be1e-ee51215f384f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.775965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40457c-7c84-4011-be1e-ee51215f384f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.776247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40457c-7c84-4011-be1e-ee51215f384f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.778036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 434/874] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:29.783322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf6c3-44ed-48f8-9035-fc726092a1af None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.783828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf6c3-44ed-48f8-9035-fc726092a1af None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.784076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf6c3-44ed-48f8-9035-fc726092a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.801381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-079cf6c3-44ed-48f8-9035-fc726092a1af None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:29.802603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-079cf6c3-44ed-48f8-9035-fc726092a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.827554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:29.881849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 441/875] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:29.905190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40457c-7c84-4011-be1e-ee51215f384f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.010239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40457c-7c84-4011-be1e-ee51215f384f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.045689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.046460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.046742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.047011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.057617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cdb1-2645-4769-98f6-67b5da5c897a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.057907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cdb1-2645-4769-98f6-67b5da5c897a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.058315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cdb1-2645-4769-98f6-67b5da5c897a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.059522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:30.060469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 442/876] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:30.067160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1594-4151-4a78-b7a2-eafdccdcb101 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.067554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1594-4151-4a78-b7a2-eafdccdcb101 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.067927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1594-4151-4a78-b7a2-eafdccdcb101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:30.069386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:30.070607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:30.071700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:30.074197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 435/877] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:30.083069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.089778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e59b1594-4151-4a78-b7a2-eafdccdcb101 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:30.091522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e59b1594-4151-4a78-b7a2-eafdccdcb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:30.101453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.168768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 443/878] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:30.169984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61718f-fdcc-47da-8bc1-3828d3f4f2a9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.170376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61718f-fdcc-47da-8bc1-3828d3f4f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.170725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61718f-fdcc-47da-8bc1-3828d3f4f2a9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.172219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 444/879] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:30.177406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.177781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.178156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.196318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:30.197599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:30.211854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5247b9c-1f6f-4a89-8988-b58c350b912a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.245820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.247150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.247437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.247713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.248455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:30.248760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.250130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.258364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 436/880] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:30.263954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.267390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 445/881] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:30.274136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.290662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.345965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.368772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65003-514d-4d46-b731-4c7b8fc39823 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.375066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f59c1-42d4-4833-8f8f-b6dba11ef3a5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.401861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.402588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.402878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.403159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.403875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.405239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.407814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.408594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.408869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.409145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.418883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 437/882] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:30 2022] POST /identity/v3/services => generated 269 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:30.419666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.430666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.433198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1671bff1-35e0-49f9-aaf2-e475fc708c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:30.455903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:30.456899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:30.457785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:30.457785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:30.457785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:30.457785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:30.457785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 446/883] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:30.458758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd151-b867-42b0-8b69-75ac769f11b3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.458758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd151-b867-42b0-8b69-75ac769f11b3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.459039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd151-b867-42b0-8b69-75ac769f11b3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.460497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 447/884] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:30.465924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdd151-b867-42b0-8b69-75ac769f11b3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.545318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.552585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175235c-48b8-45cd-aec2-2ec90c66a5b9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.584341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.588430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdd151-b867-42b0-8b69-75ac769f11b3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.591212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.592541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.592721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.593075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.593737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.595377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d059029b-d9e0-4f07-9ac2-679ecab6fdb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:30.610915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:30.611958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:30.612786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 438/885] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:30.613567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.613567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.614709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.628888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.629610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.629904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.630238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.630467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:30.631011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:30.631316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.631640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:30.632725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.649428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 448/886] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:30.649428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.708306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 439/887] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:30.709146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.763164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4861e-bb6a-4df9-9401-9e7800a16140 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.789099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.801313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.801986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.802407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.802575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.803281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:30.803591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.804946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.810140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 449/888] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:30.811007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.827881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd725-044f-4903-a7c1-c4d60d77b91e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.853269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:30.865362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.866141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.866423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.866701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.874512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.875977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:30.891162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:30.892356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:30.893332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 440/889] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:30.893949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.926247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b09ee6-0e5b-408e-8fe7-001252abb9e1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.962023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.963222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.963663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.964108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.964819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.966408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:30.978707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:30.979705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:30.981187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 450/890] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:30.986075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.998952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ed79-9b95-4b1e-b1db-20fca1aea187 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.031692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.032409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.032637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.032916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.033610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.033915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.035307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.039799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 441/891] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.040884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.054717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.109407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a281-d35b-4a70-a7ba-912d39dce4ba None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.124979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.153000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.153696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.153981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.154313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.155170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.155482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.156934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.178134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 451/892] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.185473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.191499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095fa1f-cd9c-4f33-9f0b-d7b30ac1b463 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.233990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.234346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.234508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.234756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.235473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.235779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.237144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.243012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 442/893] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.248658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.307109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96887c9-5e06-4252-998a-27f2255021fe None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.332020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.345964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.346666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.346954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.347231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.370631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a0ae7-29d4-4abb-8c5b-4ef4d7ac322d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.385504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.407774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.408446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.408728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.408999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.409701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.410187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.411401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.422655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 443/894] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.423794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.438993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.440848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.547535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69026d-ffcb-4eee-a31c-440cbe2b478e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.562861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 452/895] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:31.569743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.589362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.593798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.594692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.595177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.595617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.596577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] RBAC: Adding query filter params (interface=public, service_id=939eab67c66142ad81d5020608db8c51, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.597052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.598606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.612013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 444/896] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/endpoints?service_id=939eab67c66142ad81d5020608db8c51&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:31.613083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.661925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.694339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ebc34-dc1e-484c-9fd4-cba399e39a20 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.730302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.731948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.732432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.732903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.737931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ca78-400a-4505-8240-81bc23aa11a3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.744686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.747043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:31.765562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:31.766693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:31.767662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:31.767662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:31.767662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:31.767662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:31.769778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 453/897] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:31.775675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.778172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.778848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.779134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.779414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.780092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.781752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.793843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 445/898] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:31.851166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:31.898544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26731-5627-494e-b8d8-d0b1b8741acb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.937441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.938522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.938905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.939284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.940113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.940525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.941991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.954257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 454/899] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.959770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.060956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46515cd-69c6-4fcc-9560-480f68ddf10c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.068378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:32.100974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.101782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.102064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.102439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.110034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.111514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:32.125950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:32.126985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:32.128126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 446/900] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:32.133018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.239195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4dbe4-2195-4b41-820e-df2d0ca1976b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.268019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:32.285213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.285903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.286234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.286513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.287369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:32.287687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.289121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f985c4-b76f-4896-a128-ce7a8ed08726 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.303195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 455/901] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:32.309145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.413650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226032-fd73-471a-a0a1-e8fb00faf64e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.447599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.448267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.448551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.448826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.450209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] RBAC: Adding query filter params (role.id=c79dd0ded01d439799498a229efae083, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=123e880f189146e4bae93a06a981fbd8) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:32.450525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.451950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d98cc6-f55c-41b9-b18d-3aacee836099 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.457855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 447/902] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:32 2022] GET /identity/v3/role_assignments?user.id=123e880f189146e4bae93a06a981fbd8&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=c79dd0ded01d439799498a229efae083 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:32.525400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d007-f874-47bf-a225-2a101709472d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.525696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d007-f874-47bf-a225-2a101709472d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.525961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d007-f874-47bf-a225-2a101709472d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.528275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 456/903] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:32.534155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.534465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.534714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.554060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:32.555723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:32.584281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:32.632996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 448/904] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:32.655836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9d007-f874-47bf-a225-2a101709472d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.760177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9d007-f874-47bf-a225-2a101709472d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.800808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.801559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.801844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.802135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.802811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.804171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:32.817434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:32.818435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:32.819263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 457/905] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jul 13 08:44:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:32.827429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.935287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9db9b5-ac79-4ddb-a7ef-e3695ab58db6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.971551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.972240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.972505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.972785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.973489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:32.973796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.975194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.980310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 449/906] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:32.985532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:33.046517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:33.091806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a433-9664-4441-9dd6-33125691a57a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:33.127014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:33.127686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.127972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.128253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.129021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:33.129331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:33.130780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896664-fe3e-4e8c-aa17-9ac0dee43fcf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:33.136240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 458/907] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:33.141626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:33.186490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:33.248245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47bd5-e26c-451c-9b14-6677dc78f37d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:33.283865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe952-7f5b-42e8-9abb-c8040acb83f9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.284170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe952-7f5b-42e8-9abb-c8040acb83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.284427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe952-7f5b-42e8-9abb-c8040acb83f9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.285078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:33.285975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.286097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 459/908] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:33.286548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.286972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.287892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] RBAC: Adding query filter params (interface=public, service_id=e3a032f7c0444571b2f9fd41856becc3, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:33.288347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:33.289964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:33.291595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.292262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.292688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.297347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 450/909] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:33 2022] GET /identity/v3/endpoints?service_id=e3a032f7c0444571b2f9fd41856becc3&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:33.306165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:33.313325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:33.314646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:33.406258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:33.410170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 460/910] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:33.425703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb334a9-c750-41e4-af06-6d1e42a0a478 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:33.434352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:33.468802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:33.469823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.470365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.470840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.471737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:33.473292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8790-e43d-494d-bc85-989586cf5651 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:33.479737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 451/911] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:33 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:33.490135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:33.557188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bebaf-da35-459a-88ae-390ee53ae9d7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:33.597670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:33.598385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.598668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.598983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.599720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:33.601165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76392-309d-462f-9b95-91acb9931497 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:33.626362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 461/912] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:33 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:33.987223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837432-7450-4e71-a090-ced58aff2524 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.987737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837432-7450-4e71-a090-ced58aff2524 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.987845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837432-7450-4e71-a090-ced58aff2524 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:33.989410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 452/913] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:33.994607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:33.995013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:33.995226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.012268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:34.013468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:34.090544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 462/914] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:34.115501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837432-7450-4e71-a090-ced58aff2524 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.224868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837432-7450-4e71-a090-ced58aff2524 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:34.259571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:34.260295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.260575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.260849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.261519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:34.263421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:34.275316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:34.276312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:34.277393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 453/915] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:34.282772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.310681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:34.382457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e86fa-c6b8-46ce-ad57-453bae4063ff None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:34.416938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:34.417609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.417926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.418234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.418990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:34.419296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:34.420698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66b41f-29af-43e9-b694-9f80d5b41399 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:34.425844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 463/916] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:34.431374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.451739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:34.534198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400f24-6c29-4383-9d3d-a81fc36aa197 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.534650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400f24-6c29-4383-9d3d-a81fc36aa197 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.535026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400f24-6c29-4383-9d3d-a81fc36aa197 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.536740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 464/917] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:34.539667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043643fa-6567-4744-b999-141a2cf6ec62 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:34.542320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.542606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.542931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.559977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:34.561270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:34.579455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:34.580771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.581275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.581749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.582672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:34.583674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:34.585524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:34.593426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 454/918] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Jul 13 08:44:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:34.599124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.645119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 465/919] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:34.667676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.693486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:34.696643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:34.718510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3659-a12f-4e7c-a1b0-9896cc6d284d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:34.756253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:34.757423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.758008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.758513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.759467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:34.761156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:34.773187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef1ebf-dc00-43d7-a68d-b018128efbf8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:34.785588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 455/920] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:34.829127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:34.830501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:34.831121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:34.831605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:34.844397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:34.853681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:34.854756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:34.856191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:34.859209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 466/921] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:34.865932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:34.979221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990750cf-f6e7-4c22-8e6f-6948cdc37e4e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.014287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.015712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.016254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.016715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.017651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:35.018154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.019730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.022388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.033152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 456/922] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:35.038929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.127061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.150467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44dd5-5e35-4a14-979f-71de9ba1ff20 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.185646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.186872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.187353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.187820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.199065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.200804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:35.218835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:35.219751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:35.220728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:35.220728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:35.220728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:35.220728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:35.222991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 467/923] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:35.234174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.337212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab49c-798c-4cb1-9a9b-6508946ee17b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.374023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.374719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.375001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.375278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.375991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:35.376293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.377649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.389831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 457/924] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:35.395519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.497815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a476a91-51f0-49d1-8a30-5132c2d32fe6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.531014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.537098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.538314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.538942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.539216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.547274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.548718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d666438a-5491-4f09-a044-b473421fb9c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:35.563734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:35.564686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:35.565607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 468/925] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:35.571107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.609748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aed1c-baa0-479d-af0c-6eedf2413c84 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.609931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aed1c-baa0-479d-af0c-6eedf2413c84 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.610244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aed1c-baa0-479d-af0c-6eedf2413c84 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.611607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 469/926] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:35.616447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.616739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.617011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.633549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:35.634773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:35.637306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.690990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71055469-7b60-42e7-83f3-e68cbcb776de None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.714500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 470/927] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:35.730582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.731637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.732105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.732562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.733743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:35.737949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.738676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.741216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.771532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 458/928] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:35.776732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.858873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c69f5-955d-4c15-94a8-1cce0bcf17f3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.878860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.883907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294e54d-c76c-4d16-ad75-e0b31f499e35 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:35.893934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.895033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.895322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.895603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.896258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.897625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.905107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b0103b90-f56b-4d3e-a78c-16a3f35c6598 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:35.910702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:35.911613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:35.912417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 471/929] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:35.913731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e640b-1508-413a-8fe3-21a0c6da6f73 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.913827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e640b-1508-413a-8fe3-21a0c6da6f73 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.914074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e640b-1508-413a-8fe3-21a0c6da6f73 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.915729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 472/930] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:35.917931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e640b-1508-413a-8fe3-21a0c6da6f73 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:35.931178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:35.931973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.932301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.932529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.943624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:35.945118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e073d3a9-3aea-45c5-87bf-b4131236d62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:35.963371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:35.964301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 459/931] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:35.970357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:35.984973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:35.986174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:36.030385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e640b-1508-413a-8fe3-21a0c6da6f73 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.064015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 460/932] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:36.064015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.074834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.075645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.075998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.076342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.077132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.077505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.079009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.085102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 473/933] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:36.091207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.145418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.179041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.182651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6b0f2-c92f-43cb-bf0e-680125da0d96 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.202090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c425-644f-4963-8771-0cac9d7fc1f0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.218721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.219477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.219820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.220172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.220895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.221203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.222601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.235115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 461/934] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:36.235901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.238478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.239148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.239432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.239713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.240430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.240757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.243108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.250243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 474/935] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:36.251131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.345777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e2395-2464-44ce-81ae-5588d9d89e27 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.350322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45e40-973c-4911-b350-1b369f46feb8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.364421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.381039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.381839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.382135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.382566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.383123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.384385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.387697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.388490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.388776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.389054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.395947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:36.396240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:36.397178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:36.398426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:36.399363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.399435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 462/936] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:36.399435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:36.417373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:36.419041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 475/937] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:36.419920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.427356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.511254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50e41b-bb46-4883-9760-c4f11f6a8911 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.525249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994027a4-15a1-40a0-8201-dcfc60c0766b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.548109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.549233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.549785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.550509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.551345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.552963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.559807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.560465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.560748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.561022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.561715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.562017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.563464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.568617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 476/938] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:36.569387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.577338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 463/939] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:36.578529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.615543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.682234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.697036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accb40d-5b94-4887-9f27-ee34b1f63d1f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.721330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6c91-a0a6-4959-aba7-047e2fd317fb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.738772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.739807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.740378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.740957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.741967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.742513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.744357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.760012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 477/940] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:36.765731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.771347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.772065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.772357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.772638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.773358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.773669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.775080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.786270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 464/941] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:36.790440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.891725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:36.898916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cd282-0564-4b8c-af96-727cd70499ed None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.915036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e2f7a-3f78-4fc1-99a9-4944098af204 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:36.942448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.943279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.944222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.944499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/123e880f189146e4bae93a06a981fbd8/roles/c79dd0ded01d439799498a229efae083` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.947495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=123e880f189146e4bae93a06a981fbd8, role_id=c79dd0ded01d439799498a229efae083)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.949580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238739d-7376-40c6-a7d9-6290ae2b9a45 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.955750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:36.956958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:36.957528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:36.958005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:36.959197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] RBAC: Adding query filter params (interface=public, service_id=f6804b2502d446b7b15d99b8373f4387, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:36.960251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:36.962224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:36.970205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 465/942] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/endpoints?service_id=f6804b2502d446b7b15d99b8373f4387&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:36.971162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 478/943] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:36 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/123e880f189146e4bae93a06a981fbd8/roles/c79dd0ded01d439799498a229efae083 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:36.976489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:36.979961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:37.013752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940b19-fac8-4317-addb-01cbf7b8f9c3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.014013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940b19-fac8-4317-addb-01cbf7b8f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.014345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940b19-fac8-4317-addb-01cbf7b8f9c3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.015930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 479/944] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:37.022902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.023224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.023462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.046346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:37.048119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:37.099237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574521d-18f3-485c-a7a6-abd0e718d4b7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:37.146003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:37.146705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.146985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.147260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.147937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:37.149291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:37.156436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 466/945] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:36 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:37.158699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 480/946] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:37.183651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:37.257694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:37.296827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb34a5-fcff-4214-9fe2-82860514c837 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:37.337493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:37.338212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.338503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.338782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.339501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:37.340978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:37.342381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING keystone.server.flask.common [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 08:44:37.361556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.sql.core [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 08:44:37.361556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 08:44:37.361556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [parameters: {'id': '8f34ef7992aa4da99e45d49e6cf1a909', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 08:44:37.361556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8f34ef7992aa4da99e45d49e6cf1a909.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8f34ef7992aa4da99e45d49e6cf1a909. Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:44:37.369447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 13 08:44:37.370318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application yield resource Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise self.value Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application session.commit() Jul 13 08:44:37.372034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.flush() Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application compat.raise_( Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 08:44:37.372968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 08:44:37.373899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:44:37.374729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [parameters: {'id': '8f34ef7992aa4da99e45d49e6cf1a909', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:37.375598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:37.376361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8f34ef7992aa4da99e45d49e6cf1a909. Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:37.377280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 467/947] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Jul 13 08:44:37 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:37.384861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:37.473723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:37.489474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5e190-f202-48d9-ae4e-97e4d053e2fc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:37.525811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:37.526904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.527633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.528163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.536007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:37.537629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a76ee611-53fa-4404-a85b-4af3f9ef1d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:37.552069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:37.553147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:37.554257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:37.561283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 481/948] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:37.563023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:37.666608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10e47a-d3ff-4551-8c66-a74b394d5251 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:37.690881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:37.703054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:37.703856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:37.704195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:37.704478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:37.705234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:37.705539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:37.707197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33db3c6-dce2-4b19-8725-034a19c8c459 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:37.727905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 468/949] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:38.733152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33482-af4f-4cfa-92fa-0dd234bfc6a2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:38.733664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33482-af4f-4cfa-92fa-0dd234bfc6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:38.733742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33482-af4f-4cfa-92fa-0dd234bfc6a2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:38.735327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 482/950] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:38.740455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:38.740874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:38.741044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:38.758783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:38.760288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:38.829388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 469/951] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:38.851315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33482-af4f-4cfa-92fa-0dd234bfc6a2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:38.965611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33482-af4f-4cfa-92fa-0dd234bfc6a2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.000961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.002091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.002607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.003112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.003968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.005529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-179db708-a0a3-40a5-ba0c-333b092e0baa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:39.018451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:39.019460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:39.020296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:39.023149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 483/952] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:39.030153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.104577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5ce0-99e0-4f63-801f-7027a95101ea None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.104921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5ce0-99e0-4f63-801f-7027a95101ea None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.105641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5ce0-99e0-4f63-801f-7027a95101ea None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.116730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 484/953] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:39.124295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.124850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.125326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.138133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a675-8a5b-4597-8128-d516f3c6b7c7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.148303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:39.149425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:39.151371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.153179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.178683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.179672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.180167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.180620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.181630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:39.182187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.184280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.189905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 470/954] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:39.195763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.220073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 485/955] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:39.243271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.303847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c807dfb-2565-4c70-9895-c136cb5bcb8d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.341570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.342263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.342558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.342842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.343531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:39.343761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917a63c-ab64-4422-966c-5194e5f6091d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.343883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.345176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb4ff1-131a-4edd-8008-b71a79dad712 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.350417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 471/956] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:39.351475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cfce-9c01-4970-8d2f-0a40c187a64c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.351766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cfce-9c01-4970-8d2f-0a40c187a64c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.352043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cfce-9c01-4970-8d2f-0a40c187a64c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.353420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 472/957] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:39.359551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.359861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.360120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.379814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:39.380973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:39.399105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.401009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.401528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.402049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.415392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.420728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:39.421538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:39.434775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:39.436026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:39.437082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:39.440026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 486/958] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:39.446040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.478504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 473/959] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:39.493301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.576499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec254c18-f95e-4910-907e-ee69168304fc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.612134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.612804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.613078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.613357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.614094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:39.614423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.615774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.621554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f8c1-9e3a-4340-918f-8894efc30f3d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.627017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 487/960] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:39.634613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.657846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.658681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.658959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.659232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.659874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.661226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:39.674580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:39.675627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:39.676484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 474/961] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:39.682961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.710386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.729583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.759061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450649-acb7-436f-b72a-bf91ed967bbc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.807203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.808755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.809010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ed203-a773-42fa-9d16-ede9e819fb02 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.809447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.809689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.823424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.825051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:39.845730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:39.846688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:39.847585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:39.847585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:39.847585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:39.847585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:39.850583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 488/962] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:39.851914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.852823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.852997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.853454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.853950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.854868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:39.855929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.857694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.869580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 475/963] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:39.870882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.965124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb507c-e476-48d7-8ab8-fd2ebec58bf4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.974764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:39.978525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26eb1c-c04b-4b28-b5b6-bbb3d4e6b23f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.983505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.006243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.006909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.007200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.007454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.008224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:40.008530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.009935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.013386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.014061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.014376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.014659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.015379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:40.015670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.017026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d10210-541e-40ff-b7f1-cd0a31778a9c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.026703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 476/964] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:40.026703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcbef-c883-4b1b-96a3-31aee1a73483 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.026703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcbef-c883-4b1b-96a3-31aee1a73483 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.026703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcbef-c883-4b1b-96a3-31aee1a73483 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.030212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 477/965] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:40.031602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 489/966] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:40.032476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.032772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.033054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.033150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.049895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:40.051174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.120763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 478/967] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:40.121501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.161047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1651c-e8a2-4bbf-9ba3-f932dbdda341 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.197196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.198600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.199405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.199682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.200416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.201773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.219871 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.222988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 490/968] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:40.224085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.242984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5860-c759-4a3d-adbb-22e9831b5016 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.265900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.292943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.293875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.294313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.294797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.303736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.305335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:40.322654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:40.323680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:44:40.325206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:40.329948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 479/969] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:40.330694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.372911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7237-51e3-441a-b7b4-ce7d81d60ee4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.421821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.422578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.422863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.423138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.423863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.425269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.426742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING keystone.server.flask.common [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 08:44:40.441591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.sql.core [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 08:44:40.441591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 08:44:40.441591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [parameters: {'user_id': 'beed4d7d506441f38b56ae8e7133d405', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 08:44:40.441591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 08:44:40.452960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5ba9-8fd9-4399-b330-5569da2e5224 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result.read() Jul 13 08:44:40.458377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:44:40.459291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application yield resource Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application next(self.gen) Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise self.value Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application session.commit() Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 08:44:40.460755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.session.flush() Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application compat.raise_( Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 08:44:40.461885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 08:44:40.463196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application conn.query(q) Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result.read() Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 08:44:40.464061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [parameters: {'user_id': 'beed4d7d506441f38b56ae8e7133d405', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:40.466173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 13 08:44:40.468128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 491/970] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Jul 13 08:44:40 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:40.470583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.517634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.520513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.521015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.521762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.522822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:40.523602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.526013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.556199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 480/971] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:40.557822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.570996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.575617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.587238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce947-604e-4f2e-98f8-3c812c5957d2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.626068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.627080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.627403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.627841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.635851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.637651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:40.652242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:40.653391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:44:40.654579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:40.660994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 492/972] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:40.661951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.697840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04680cc4-8f42-49b5-9476-9ae1213292e7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.743273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.744658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.745114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.745560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.769908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee110c-d469-4635-a5d4-5ad6061cc1c0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.810459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.811276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.811690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.812066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.812976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:40.813380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.815282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.836040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.838154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.847830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:40.859273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 493/973] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:40.961321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 481/974] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:40.963036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.977619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:41.079407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2b092-4471-40e7-8db9-13a53c7c6104 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.118388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.119447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.119926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.120411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.131651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.133101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:41.151431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:41.152886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:41.153753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:41.153753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:41.153753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:41.153753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:41.156702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 494/975] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:41.159166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.265141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e154b1-0b5f-4dd0-9537-7e92eb81b8fe None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.273339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:41.301724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.302439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.302723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.302995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.303705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:41.304005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.305357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a20a8-e2d0-481b-8b90-bf001314904f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.320844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 482/976] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:41.322508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.387898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:41.422513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc924-2500-40d2-8321-1b1b2adc5f4b None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.422878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc924-2500-40d2-8321-1b1b2adc5f4b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.423084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc924-2500-40d2-8321-1b1b2adc5f4b None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.424585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 483/977] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:41.428376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6560-954d-4594-bf49-987621d824f1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.429419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.429709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.429997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.446166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:41.447352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.462764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.463559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.463841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.464115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.471376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.472812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:41.488765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:41.489636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:41.495620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 495/978] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:41.496339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.516814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 484/979] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:41.539046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.605508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965289-3558-420f-bfea-f8cfcea73570 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.627954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:41.633947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:41.641938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b03fa-099f-4b7c-b3f6-c6668dac6ab8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.643821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.644485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.644764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.645043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.645826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:41.646156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.647589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.661771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 496/980] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:41.667731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.681673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.682532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.683220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.683499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.684366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.685731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7ff9b-aab0-4129-a993-4f88f28709ac None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.700945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 485/981] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:41 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:41.782399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104fac9-5fb5-4406-b158-4e009e4538fe None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.830267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.831039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.831333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.831615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.832469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] RBAC: Adding query filter params (role.id=c79dd0ded01d439799498a229efae083, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=123e880f189146e4bae93a06a981fbd8) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:41.832786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.834334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeea7-7448-419f-acda-acf0b983620b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.850153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 497/982] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:41 2022] GET /identity/v3/role_assignments?user.id=123e880f189146e4bae93a06a981fbd8&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=c79dd0ded01d439799498a229efae083 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:42.279603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd633-ebb1-40a5-997a-8996848d6670 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.280133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd633-ebb1-40a5-997a-8996848d6670 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.280238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd633-ebb1-40a5-997a-8996848d6670 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.281664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 486/983] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:42.286705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.286997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.287274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.304613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:42.306103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.341892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:42.375841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 498/984] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:42.397411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd633-ebb1-40a5-997a-8996848d6670 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.496974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd633-ebb1-40a5-997a-8996848d6670 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.529617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.530455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.530737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.531006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.531666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.533012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:42.547465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:42.548448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:42.549299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:42.553643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 487/985] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:42.554524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.650314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f826-8ad7-42b7-9b5b-613cdf32711e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.682389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.683048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.683846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.684117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.684806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:42.685106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.686467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.691579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 499/986] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:42.696935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.719170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:42.796562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f9443-bbc1-45ba-88f6-68849faa5ab7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.831252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.831943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.832227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.832505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.833227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:42.833538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.834986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.845375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 488/987] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:42.846556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.883803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:42.951335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d942-32d4-4589-affc-457811c4c3ea None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.987379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.988041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.988320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.988592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.989388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] RBAC: Adding query filter params (interface=admin, service_id=f6804b2502d446b7b15d99b8373f4387, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:42.989696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.991076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58bd0f-b96f-4cc8-8da0-8b584bc04c48 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.997041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 500/988] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Jul 13 08:44:42 2022] GET /identity/v3/endpoints?service_id=f6804b2502d446b7b15d99b8373f4387&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:43.002270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.085534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:43.101429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8ea6a-39c4-4a1c-9e29-b9cbb06bde14 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.139499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.140166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.140450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.140728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.141405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.142800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c3d2f-226c-4dc1-b32e-091f5d9deec0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.154154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 489/989] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:43 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:43.758856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec95732-677d-45ef-bb5a-0e992a792192 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.759257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec95732-677d-45ef-bb5a-0e992a792192 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.759459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec95732-677d-45ef-bb5a-0e992a792192 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.760957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 501/990] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:43.766388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd96f-c64e-4551-8051-c69053adf609 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.766843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd96f-c64e-4551-8051-c69053adf609 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.767007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd96f-c64e-4551-8051-c69053adf609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.784538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f4cbd96f-c64e-4551-8051-c69053adf609 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:43.785713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f4cbd96f-c64e-4551-8051-c69053adf609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.860500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 490/991] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:43.883010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec95732-677d-45ef-bb5a-0e992a792192 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.905424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4a5e7-ffd8-4b75-b142-28487fae848f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.905712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4a5e7-ffd8-4b75-b142-28487fae848f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.905993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4a5e7-ffd8-4b75-b142-28487fae848f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.907560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 491/992] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:43.912039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.912335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.912616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.929289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:43.930517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.989345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:43.994250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec95732-677d-45ef-bb5a-0e992a792192 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.001276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 492/993] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:44.023266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.034283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.035171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.035303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:44.035568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.036066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.036655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.038289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:44.050266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:44.051452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:44.052454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:44.056355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 502/994] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:44.057170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.137131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914c6d-2422-4ce8-a544-bc14325b2f19 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.163577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfbba8-8dbb-4155-9434-948c6dd02881 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.172332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.173136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.173418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.173693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] PATH_INFO: `/v3/services/image` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.174366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.175753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:44.187865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:44.188864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:44.189685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 493/995] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:44.194683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.205995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.206682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.206964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.207237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.207933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:44.208237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.209595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.214764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 503/996] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:44.223230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.259487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:44.270702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:44.301329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2be1-0d47-43fe-8d18-e414aa60a049 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.338533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e347-27fd-4e69-a641-3b1b295e7f4d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.341599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.342308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.342590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.342865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.343560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] RBAC: Adding query filter params (name=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:44.343866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.345219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.350159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 494/997] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:44.356185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.374713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.375385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.375669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.375946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.376653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:44.376964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.378350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.383485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 504/998] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:44.388743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.462062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03846e2e-f524-4b94-b74e-8a2c38a5ee40 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.485168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:44.494890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76c12-298a-4408-986f-4e6d0075e7d2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.500800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.501470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.502150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.502150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.502864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:44.503172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.504652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.506825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:44.514538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 495/999] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:44.530641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.531324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.531604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.531879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.532808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] RBAC: Adding query filter params (interface=public, service_id=1ef400c9178246cead7abdd486d8fec2, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:44.533123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.534561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2baab-4206-4f31-9a4a-b7a8d973889f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.540941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 505/1000] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/endpoints?service_id=1ef400c9178246cead7abdd486d8fec2&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:44.547029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.655123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd19ba-ffb6-4df1-982c-79f6a5ae2dd7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.691261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.691937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.692223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.692500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.693176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.694575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad888-c38f-45e6-a737-e0904ecdd83e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.701132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 496/1001] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:44 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:45.177218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0c56-77d2-4648-b4fe-ab9ee245e508 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.177723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0c56-77d2-4648-b4fe-ab9ee245e508 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.177825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0c56-77d2-4648-b4fe-ab9ee245e508 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.179328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 506/1002] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:45.184504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.184914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.185095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.202735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:45.203923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:45.261688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:45.269943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 497/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:45.292906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0c56-77d2-4648-b4fe-ab9ee245e508 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.395790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0c56-77d2-4648-b4fe-ab9ee245e508 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.428949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.429754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.430039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.430345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.430991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.432341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:45.444251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:45.445192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:45.451527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 507/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Jul 13 08:44:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:45.453958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.552001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbec91-1538-4901-82cd-4b24c7f73eda None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.585987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.586677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.586958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.587234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.587933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:45.588238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.589622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.594677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 498/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:45.600229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.624567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:45.704659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9691c-81ed-43bc-9449-8ac44d16be45 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.737217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.737878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.738184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.738465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.739165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:45.739467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.740823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd84c1-949f-4514-b9a3-17a58bccab09 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.746511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 508/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Jul 13 08:44:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:45.752037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.811820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:45.854517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f224eb9-d624-4639-b008-7578e985a3df None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.888454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.889113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.889396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.889680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.890448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.891803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ed9f8-caae-439c-ab11-d12e71add8ba None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.914157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 499/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:46.544076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1582b-d50a-4082-84e2-9acc7aa30155 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.544590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1582b-d50a-4082-84e2-9acc7aa30155 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.544669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1582b-d50a-4082-84e2-9acc7aa30155 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.546212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 509/1008] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:46.551169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41219f3-88e0-4bd3-8801-a8e3e95ab608 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.551583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41219f3-88e0-4bd3-8801-a8e3e95ab608 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.551755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41219f3-88e0-4bd3-8801-a8e3e95ab608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.568666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f41219f3-88e0-4bd3-8801-a8e3e95ab608 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:46.569854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f41219f3-88e0-4bd3-8801-a8e3e95ab608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:46.641563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 500/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:46.664238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1582b-d50a-4082-84e2-9acc7aa30155 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:46.695910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981787b-c1bd-487a-aee5-056d822ced44 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.696211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981787b-c1bd-487a-aee5-056d822ced44 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.696468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981787b-c1bd-487a-aee5-056d822ced44 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.697952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 501/1010] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:46.702997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.703283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.703560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.720652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:46.721828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:46.751404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:46.764371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:46.773562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1582b-d50a-4082-84e2-9acc7aa30155 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:46.791719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 502/1011] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:46.807033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:46.807637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.807919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.808217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.808945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:46.810317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:46.813448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:46.827826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 510/1012] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:46 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:46.924235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170434-ab99-4970-835f-aa4e0ee3415e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:46.968176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:46.968993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.969272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.969543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.970214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:46.971580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:46.984173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:46.985187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:46.986298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 503/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:46.991380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:47.096974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec733-fd92-4818-806c-b8eaaba7b019 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:47.137401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:47.138065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.138373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.138647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.139347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:47.139649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:47.140995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:47.146151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 511/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:47.151442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:47.187051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:47.251836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf006-de83-4bd1-89fa-c6cd286d78f1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:47.284135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:47.284796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.285075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.285349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.286038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:47.286370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:47.287712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7938213-7a18-4c11-95a5-3dab0b48574c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:47.292869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 504/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Jul 13 08:44:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:47.298290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:47.310492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:47.401049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e880ad-540a-4d82-8ae0-2660c9765d63 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:47.434550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:47.435212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.435493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.435766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.436502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:47.437843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f55f6-cde4-4e76-9ed4-262e698e4cb2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:47.460658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 512/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:47.942767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8f354-d70b-4220-ac1b-ef1a97d4e353 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.943311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8f354-d70b-4220-ac1b-ef1a97d4e353 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.943311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8f354-d70b-4220-ac1b-ef1a97d4e353 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.944835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 505/1017] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:47.949844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.950257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.950433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.968651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:47.969899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:48.029290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:48.046666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 513/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:48.069373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8f354-d70b-4220-ac1b-ef1a97d4e353 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:48.174189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:48.180164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8f354-d70b-4220-ac1b-ef1a97d4e353 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:48.213553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:48.214857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:48.215190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:48.215464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:48.216639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:48.218137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df13a9-26d5-4dc7-a403-cf73a043d4fe None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:48.219978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 506/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:48.225709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:48.323421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4feb-c7cf-4799-98dd-0d14ce006eef None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:48.357512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:48.358470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:48.358943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:48.359434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:48.360323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:48.361931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdcea6-d7ee-4311-8232-48b923099f8a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:48.389067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 514/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:44:48 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:48.891638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c5c0-1ed6-4230-b519-d5ded33ee5df None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:48.891969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c5c0-1ed6-4230-b519-d5ded33ee5df None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:48.892206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5c5c0-1ed6-4230-b519-d5ded33ee5df None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:48.893737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 507/1021] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:48.898811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:48.899179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:48.899693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:48.916558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:48.918281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:48.952933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:48.990144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 515/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:49.010205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c5c0-1ed6-4230-b519-d5ded33ee5df None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.116937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5c5c0-1ed6-4230-b519-d5ded33ee5df None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.153947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.154660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.154943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.155215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.155858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:49.157209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:49.169448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:49.170728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:49.171606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:49.172938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 508/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:49.176544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.276347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df477a-fea8-4de8-a4ba-666e72b1bbaa None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.310301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.310972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.311270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.311543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.312247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:49.312558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:49.313919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:49.323542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 516/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:49.324735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.356726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:49.426546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091a665-65f0-44e1-a419-468b85c205c0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.458544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.459214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.459497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.459771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.460471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] RBAC: Adding query filter params (type=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:49.460775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:49.462139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d2042-6f36-4578-9b09-4b07a7e3f9ca None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:49.472314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 509/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:49.473575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.508277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:49.558104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a03f-bb76-488a-9b65-6e22e8204da0 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.558709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a03f-bb76-488a-9b65-6e22e8204da0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.559114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a03f-bb76-488a-9b65-6e22e8204da0 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.560514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 510/1026] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:49.565338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.565626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.565900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.577955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be668f-1cf5-4c12-9a85-155db8f440c6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.582508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:49.583694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:49.613182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.613843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.614142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.614433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.615206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] RBAC: Adding query filter params (interface=public, service_id=8313c960af4f4676b5d5b62f48c222d8, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:49.615513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:49.616852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:49.622800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 517/1027] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/endpoints?service_id=8313c960af4f4676b5d5b62f48c222d8&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:49.628179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.655660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 511/1028] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:49.679056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.710873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:49.730703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:49.734453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f368ae-d5cb-47b2-8fa3-cb9f090f030d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.770406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.771065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.771345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.771615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.772283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:49.773622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:49.780942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 518/1029] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:49.786931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94536-74d9-4bbf-98fe-79c4aaafecb6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:49.825200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:49.826058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:49.826395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:49.826674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:49.838807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:49.848191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:49.849208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:49.850823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 512/1030] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:49.855862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:49.966549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5e49-6aee-4e9f-bb52-fcedcb81146a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.001410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.002089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.002398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.002675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.003422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:50.003729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.005088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.018559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 519/1031] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:50.020090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.113472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.130402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc72d5e-6a57-4903-b6bb-1be3c10f036a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.165506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.166338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.166628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.166904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.177512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.178995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:50.196672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:50.197596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:50.198631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:50.198631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:50.198631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:50.198631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:50.202185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 513/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:50.204678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.233046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.306684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4b492-1242-4fab-9558-808520e9fb33 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.340032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.340693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.340972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.341243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.341959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:50.342288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.343641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b250f2-1d27-4612-b78b-22cdd4c34ec8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.356169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 520/1033] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:50.361436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.437041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086253-5b5d-4ad1-a6a8-712edad57103 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.437363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086253-5b5d-4ad1-a6a8-712edad57103 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.437592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086253-5b5d-4ad1-a6a8-712edad57103 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.439128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 521/1034] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:50.443662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.443952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.444225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.460683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:50.461009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d5fa-ae02-48b3-8d79-4f1e9c08a0a7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.461857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:50.499406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.500435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.500909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.501348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.504734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.511382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.513862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:50.531492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:50.532511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 514/1035] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:50.538475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.539725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 522/1036] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:50.556873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.574467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.644949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaaa5c-e404-4e04-a9e2-b68028207875 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.661112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d915-eb79-435a-a074-6d71477e70ef None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.678417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.679087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.679368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.679645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.680465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:50.680770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.682199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.699180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 515/1037] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:50.700601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.701607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.702135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.702609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.703970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.704571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.705986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.708446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 523/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:50.713490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:50.759239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.799228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:50.805703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8075f-190d-4c3a-92e3-8d6c7a152042 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.818608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee7fd-5f36-49e0-8460-966daf9571bc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:50.840208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.840863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.841152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.841430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.858953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:50.859638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:50.859934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:50.860203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:50.861109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.862826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.883483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 524/1039] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:44:50 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:50.921074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:50.923030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:50.981660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:51.030023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 516/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:51.035496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:51.146462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d78a-f568-427a-b03b-70f42baddbff None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:51.180694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:51.181489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.181770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.182042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.190513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:51.192763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:51.194213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:51.213036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:51.213947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:51.215467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:51.215467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:51.215467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:51.215467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:51.215467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 525/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:51.220329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:51.317172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b20e-2c5e-4e2c-b72a-d4c62dcbb811 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:51.350875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:51.351538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.351821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.352094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.352805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:51.353106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:51.354478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:51.365605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 517/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:51.371082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:51.473435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388ba92-3d5c-4d09-9baa-f7884cba483a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:51.506638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:51.507437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.507720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.507997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.515309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:51.516747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:51.530817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:51.531714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:51.532633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 526/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:51.539346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:51.555586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:51.640445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631aeb-de6f-48e7-802d-ae5cc3b8b2bb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:51.672714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:51.673628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.673917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.674224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.675015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:51.675321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:51.676740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbfb1a-6ddb-4f63-9fae-7de3204ced98 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:51.689772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 518/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:51.695450 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:51.748226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:51.795474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feae0c-26d8-4415-8cd9-fa991536daa8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:51.829063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:51.829710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.829970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314df37-05d7-4147-9327-8e412fb14f02 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.830094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.830308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314df37-05d7-4147-9327-8e412fb14f02 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.830411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.830590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314df37-05d7-4147-9327-8e412fb14f02 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.831223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] RBAC: Adding query filter params (role.id=c79dd0ded01d439799498a229efae083, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:51.831533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:51.832097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 519/1045] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:51.832947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:51.836764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:51.837065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:51.837349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:51.846363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 527/1046] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=c79dd0ded01d439799498a229efae083 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:51.859891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:51.861658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:51.936624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 520/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:51.959480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:52.062795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345b01-2249-471e-83f7-d46670a6673a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:52.080059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:52.100292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:52.101099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.101385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.101664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] PATH_INFO: `/v3/services/image` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.102418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:52.103793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:52.121892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:52.123057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:44:52.123925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:52.125730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 528/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Jul 13 08:44:51 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:52.127227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:52.131882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:52.229418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af10498-df25-4c65-a140-56b58173eb7a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:52.262689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:52.263358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.263646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.263927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.264706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] RBAC: Adding query filter params (name=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:52.265022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:52.266407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:52.275917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 521/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:52.277971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:52.381436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc00b9-7fc5-4b1e-9ab8-8cc12eb19347 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:52.415206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:52.415876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.416162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.416436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.417130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] RBAC: Adding query filter params (type=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:52.417980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:52.419365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f955-c809-4510-a122-98ddd7bee6ab None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:52.424395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 529/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:52.429825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:52.496883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:52.531333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f4c57-29b4-43aa-93f5-5224a887882d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:52.565531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:52.566228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.566516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.566796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.567547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:52.568909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b114dd-8872-4814-ae7d-fdac548625cd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:52.587366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 522/1051] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:44:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:53.010715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12376739-0a52-485f-971c-54a262b6bfe5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.011722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12376739-0a52-485f-971c-54a262b6bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.011902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12376739-0a52-485f-971c-54a262b6bfe5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.013397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 530/1052] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:53.018378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.018736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.019088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.035622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:53.036816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:53.112192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 523/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:53.136807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12376739-0a52-485f-971c-54a262b6bfe5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:53.182797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:53.237972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12376739-0a52-485f-971c-54a262b6bfe5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:53.271456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:53.272255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.272533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.272805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.283476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:53.291272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:53.292208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:53.293046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 531/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:53.298626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:53.348403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:53.399484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2102-d799-4400-a562-21a9a5c790cf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:53.432564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:53.433793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.434077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.434381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.435122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:53.435427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:53.436782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:53.449350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 524/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:53.450535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:53.548297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fbbd7-08f7-4f2b-819c-b85b371b0e31 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:53.550611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:53.583998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:53.584867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.585153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.585429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] PATH_INFO: `/v3/users/b096b76d602946e6978ec4befdb10d55` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.598408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] RBAC: Authorizing `identity:get_user(user_id=b096b76d602946e6978ec4befdb10d55)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:53.599830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65531f-3e41-48fd-8e17-e1746a3d7601 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:53.606505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 532/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:44:53 2022] GET /identity/v3/users/b096b76d602946e6978ec4befdb10d55 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:53.607688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:53.713607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b4d87-57d5-47f5-8a58-8259991dc687 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:53.727126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:53.749905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:53.750580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.750862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.751135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.819403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:53.820782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:53.885645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7802bc-8301-4701-9d73-3e67ac1e927d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.885973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7802bc-8301-4701-9d73-3e67ac1e927d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.886247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7802bc-8301-4701-9d73-3e67ac1e927d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.887763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 533/1057] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:53.892327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:53.892612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:53.892882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:53.909209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:53.910419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:53.921786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 525/1058] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:53.927249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:53.940050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:53.982702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 534/1059] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:54.004484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.029574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8bdda-edc6-4267-b831-fbac617742da None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.066593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.067457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.067739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.068021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.069199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.070725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.072688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 526/1060] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:44:53 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:54.078281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.101180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.112031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d8a7e-4533-4cb6-b9ed-c197319c6daf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.153772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.154440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.154602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.154844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.165903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:54.169063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:54.174852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:54.175805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:54.176869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 535/1061] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:54.181929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.193990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc4f0-5b15-4e2c-9c84-1f11e813787c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.229778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.230478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.230756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.231032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.231853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=dd98395828f54c959b6fb704371ec4db, user.id=b096b76d602946e6978ec4befdb10d55) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:54.232164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.233576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.239367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 527/1062] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/role_assignments?user.id=b096b76d602946e6978ec4befdb10d55&scope.project.id=dd98395828f54c959b6fb704371ec4db&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:54.291501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f1acd-300b-45d7-a8d9-ca8507b4d619 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.328571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.329173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.329459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.329738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.330540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:54.330853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.332246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.342058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 536/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:54.347561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.450166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3e6f-3b1e-4028-89d4-3812bfdf4013 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.495129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.496408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.496684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.496949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.507693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.509122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.512514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b63e62c1-1b93-4d9f-808b-0bd1567e33a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:54.528423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:54.529350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:54.530281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:54.530281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:54.530281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:54.530281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:54.530281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 528/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:54.536298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.552397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.623689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba76cb-1f26-431b-91ec-de078205b6ff None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.623985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba76cb-1f26-431b-91ec-de078205b6ff None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.624177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba76cb-1f26-431b-91ec-de078205b6ff None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.625692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 529/1065] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:54.630516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.631000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.631296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.642252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7429-d2cd-430e-bcd1-80023da8fe54 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.648692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:54.649991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:54.678679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.679582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.680019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.680302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.681024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:54.681331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.682729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.700475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 537/1066] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:54.702521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.720148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 530/1067] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:54.742634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.778285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.806550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c57fa4-9417-4376-a79c-ae20f60dc4a9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.842480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.843676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.844015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.844457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.851885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.853310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.855525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a145fe0-f164-47a4-8a7f-955a39b74d21 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:54.868793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:54.869765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:54.871308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 538/1068] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:54.876851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:54.885260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:54.894507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:54.895166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:54.895450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:54.895725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:54.963628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:54.965212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:54.991411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d82b-5202-4fab-a6bd-7f428760cf9a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.026127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.026881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.027169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.027445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.028284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:55.028592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.030005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.031635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.048492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 539/1069] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:55.053965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.078281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 531/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:55.083381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.113079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.168474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541a0a-e0d0-4db7-a7be-4606d18745cc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.188064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cb9a4-4e33-40da-98ea-d0ea0a83941b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.203088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.204070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.204524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.204934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.216353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.217781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.223389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.224186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.224469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.224746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.235352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:55.236415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:55.237358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:55.238319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:55.238319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:55.238319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:55.238319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:55.238545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.238618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 540/1071] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:55.243444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:55.257461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:55.258380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:55.259279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:55.259279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:55.259279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:55.259279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:55.259279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 532/1072] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:55.264498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.291490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.348986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.358718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a06d5-94fe-47f9-b6f4-a92e0a8b7e96 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.374441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5693e-f2d1-4445-9e0b-89a60fbbbbff None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.397798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.398503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.399003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.399114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.399766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:55.400076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.401438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.411524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.412192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.412506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.412785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.418812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 541/1073] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:55.418958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:55.418958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.418958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.420567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.438208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 533/1074] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:55.537515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dd2e-c1ce-49cb-8d4f-25c537bee7af None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.540322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.574980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.575789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.576076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.576355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.583400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.584867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:55.599915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:55.600854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:55.601900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 542/1075] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:55.608408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.715560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2b4ed-c42b-47bf-ba2b-7ae2495fe5f0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.747981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.748644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.748930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.749207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.749986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:55.750323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.751739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a7b7c-bee3-443a-aeca-0c74983fb59e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.758549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:55.764684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 534/1076] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:55.770627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:55.868575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc2d5-a585-4318-b149-acded0d1856e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:55.903396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:55.904279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:55.904560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:55.904835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/c79dd0ded01d439799498a229efae083` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:55.907040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=f847d12027be4164aff8449a2bd42750, role_id=c79dd0ded01d439799498a229efae083)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:55.908459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81124-21b2-431f-a4cd-a5d5237ead64 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:55.923036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 543/1077] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:55 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/f847d12027be4164aff8449a2bd42750/roles/c79dd0ded01d439799498a229efae083 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:56.271540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5626-0d6f-47e3-b059-3f0b84f03695 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.271960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5626-0d6f-47e3-b059-3f0b84f03695 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.272246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5626-0d6f-47e3-b059-3f0b84f03695 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.273630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 535/1078] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:56.278861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.279287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.279417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.295721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:56.296889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:56.313782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:56.365024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 544/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:56.387505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5626-0d6f-47e3-b059-3f0b84f03695 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:56.485409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5626-0d6f-47e3-b059-3f0b84f03695 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:56.517876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:56.518688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.518973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.519249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.529163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:56.536785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:56.537893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:56.538868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 536/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:56.544921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:56.639638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5528a-fd75-4391-9b95-b9ffc40eb0f0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:56.672857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:56.673522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.673802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.674073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.674829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:56.675131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:56.676474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:56.684987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 545/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:56.690622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:56.747686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:56.787278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a0fc-e163-41b1-a2bb-1cf75b0f6eee None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:56.824184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:56.825045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.825324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.825594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] PATH_INFO: `/v3/users/b096b76d602946e6978ec4befdb10d55` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.826787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b096b76d602946e6978ec4befdb10d55)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:56.828185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:56.829956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 537/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:44:56 2022] GET /identity/v3/users/b096b76d602946e6978ec4befdb10d55 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:56.835476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:56.854433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:56.934602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe5a2-1801-4f65-b4c3-9a1011693803 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:56.966993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:56.967855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:56.968139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:56.968411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:56.969837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:56.971022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3264-0192-49a8-8a79-1b7fa3397add None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:56.972747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 546/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:44:56 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:56.978593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:57.075035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6255-0000-4e3d-9279-2d20e7fb5bd8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:57.099664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:57.109424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:57.110343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:57.110626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:57.110901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db/users/b096b76d602946e6978ec4befdb10d55/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:57.112878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd98395828f54c959b6fb704371ec4db, user_id=b096b76d602946e6978ec4befdb10d55, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:57.114326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f36592-f8db-480a-9264-5538459bdb98 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:57.128755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 538/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:44:56 2022] PUT /identity/v3/projects/dd98395828f54c959b6fb704371ec4db/users/b096b76d602946e6978ec4befdb10d55/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:57.920725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96361-1340-4f00-a1f1-305866492e86 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:57.921242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96361-1340-4f00-a1f1-305866492e86 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:57.921347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96361-1340-4f00-a1f1-305866492e86 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:57.922724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 547/1085] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:57.927954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:57.928350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:57.928504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:57.945282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:57.946496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:58.009855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 539/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:44:58.032339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f96361-1340-4f00-a1f1-305866492e86 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.118420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:58.135504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f96361-1340-4f00-a1f1-305866492e86 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.167973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.168772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.169048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.169316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.179469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:58.188161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:58.189172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:58.190016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 548/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:58.195416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.289525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb585b4-d1d8-4702-bb76-a8520c4ce497 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.305667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:58.322775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.323463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.323741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.324012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.324738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:58.325039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.326420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.333971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 540/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:58.340071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.436088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae5bc2-64d2-440f-8e9c-a2ed6926938e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.468195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.468975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.469261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.469540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.479189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.481266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.483828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:58.499003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:58.499919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:58.500824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:58.500824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:58.500824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:58.500824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:58.500824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 549/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:44:58.505735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.600570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfdf5-4d16-4005-9197-899f6d884953 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.632547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.633205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.633485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.633758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.634499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:58.634803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.636668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.647956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 541/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:58.654073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.751223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793275-f739-463d-825a-6344f102ba05 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.784880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.785664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.785950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.786265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.793407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.794861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:44:58.808946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:58.809901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:58.810884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 550/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:58.815980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.855246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:58.914335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fac24-fdf2-4064-9608-b8d2dcdb8951 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.947141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.947812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.948094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.948891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.949714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:58.950023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.951472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe2893-38f3-47af-9085-84fc9ec7af03 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.968496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 542/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:58.974379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.028369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.070610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450f01-a7a4-45ee-8de1-3a09d77c3a24 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.103990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.104652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.104930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.105198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.123917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46442d-84fd-4f87-ba66-e8b7d4d1ccd5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.124206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46442d-84fd-4f87-ba66-e8b7d4d1ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.124482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46442d-84fd-4f87-ba66-e8b7d4d1ccd5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.125857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 543/1093] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:44:59.130576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.130867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.131146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.147652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:59.148833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:59.174634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.176064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.212423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 544/1094] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:44:59.228494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.235568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.262417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.272506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 551/1095] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:59.278090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.333727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e672d24-09e6-4519-b62c-88eb85be29c7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.366131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.366936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.367215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.367487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.372682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6533-c7b5-4021-817c-a071ca59b496 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.377723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:44:59.385260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:59.386231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:44:59.387075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 545/1096] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:59.392212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.405014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.405802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.406086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.406387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.416455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.418407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:44:59.435919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:59.436989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:59.437887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:44:59.437887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:44:59.437887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:44:59.437887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:59.437887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 552/1097] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:59.442432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.452186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.474073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.489055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aee18e-694d-4dac-8638-ab34a43dcfc2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.521118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.521774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.522053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.522357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.523088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:59.523392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.524741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.532590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 546/1098] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:59.538162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.540643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a75b20-8ec2-41f1-8358-5c97eb820ece None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.574401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.575055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.575337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.575613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.576329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:59.576634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.577984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.588953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 553/1099] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:59.594430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.634336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fad5d-6e69-4a5d-86b4-c73ee448cdb5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.659400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.666588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.667961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.668239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.668510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] PATH_INFO: `/v3/users/b096b76d602946e6978ec4befdb10d55` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.669717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b096b76d602946e6978ec4befdb10d55)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.671159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.672783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 547/1100] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/users/b096b76d602946e6978ec4befdb10d55 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:59.678284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.694896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691667af-6a71-4d42-b286-f18ea0dc66af None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.696306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.734756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.735570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.735850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.736116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.742505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.743926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:44:59.758346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:44:59.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:44:59.760383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 554/1101] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:44:59.765850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.780151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9ff-e810-48b8-9f54-3f6b5fdb51b8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.813129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.813767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.814045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.814350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.862718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcbde-db63-4ae2-8068-6e7fc2c5247d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.879188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.880617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.890190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.897368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:44:59.898178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.898989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.899306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.899583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.900355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:59.900660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.902076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.913626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 555/1102] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:59.920023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.985665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 548/1103] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:44:59.986684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.017172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3551408-d683-4ad8-8196-902babfda2e8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.050130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.050804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.051088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.051370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.052190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] RBAC: Adding query filter params (role.id=c79dd0ded01d439799498a229efae083, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=f847d12027be4164aff8449a2bd42750) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:00.052501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.053918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.060363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 556/1104] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/role_assignments?user.id=f847d12027be4164aff8449a2bd42750&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=c79dd0ded01d439799498a229efae083 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:00.081432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26265c59-4d53-4850-a36f-1a9c6e1ff496 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.099333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:00.119882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.121238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.121520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.121793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.123087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.124559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410b274-0316-4be7-be51-a89ff42be789 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.126348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 549/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:44:59 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:00.132509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.187619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:00.235584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c806-403c-4309-bd39-75766a6c772e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.269732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.270427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.270715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.270990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.271813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=dd98395828f54c959b6fb704371ec4db, user.id=b096b76d602946e6978ec4befdb10d55) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:00.272124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.273541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6bedd-4da2-4c65-a225-1a044505dba0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.279676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 557/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:00 2022] GET /identity/v3/role_assignments?user.id=b096b76d602946e6978ec4befdb10d55&scope.project.id=dd98395828f54c959b6fb704371ec4db&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:02.303760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eee7a-68db-48ce-a3ef-2e03df864738 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.304316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eee7a-68db-48ce-a3ef-2e03df864738 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.304316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eee7a-68db-48ce-a3ef-2e03df864738 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.305655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 550/1107] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:02.310850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.311276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.311418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.327906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:02.329099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.393020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 558/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:02.417521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eee7a-68db-48ce-a3ef-2e03df864738 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.512284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eee7a-68db-48ce-a3ef-2e03df864738 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.544138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.544901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.545182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.545455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.546625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.548036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e7606-5289-4fb6-92f9-367063f96f17 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.549589 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 551/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:45:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:02.555034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.600565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:02.651228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf22fcc-3270-4403-abb9-ae77996691ed None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.684003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.684661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.684940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.685211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.685900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.687334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038c18-09e1-4e2f-a67d-3d3d3a93bd86 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.706799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 559/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:45:02 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:04.723458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440d77-c217-4773-b520-6a162cf97fd6 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:04.723980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440d77-c217-4773-b520-6a162cf97fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:04.723980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440d77-c217-4773-b520-6a162cf97fd6 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:04.725362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 552/1111] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:04.731074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:04.731481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:04.731619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:04.748330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:04.749497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:04.812124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 560/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:04.834732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b440d77-c217-4773-b520-6a162cf97fd6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:04.886031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:04.931598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b440d77-c217-4773-b520-6a162cf97fd6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:04.963512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:04.964884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:04.965161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:04.965430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] PATH_INFO: `/v3/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:04.966895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] RBAC: Authorizing `identity:get_role(role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:04.968246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:04.969598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 553/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:04 2022] GET /identity/v3/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:04.975358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:05.005340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:05.072829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ceff-3f93-4bad-95d6-0bf634b13505 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:05.105371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:05.106270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:05.106554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:05.106836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] PATH_INFO: `/v3/users/22772d42bdec489da39bd5c66d07bcc2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:05.119701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] RBAC: Authorizing `identity:get_user(user_id=22772d42bdec489da39bd5c66d07bcc2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:05.121170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:05.122869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 561/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:04 2022] GET /identity/v3/users/22772d42bdec489da39bd5c66d07bcc2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:05.128419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:05.222401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26820-9094-4c13-9cc0-737ce25b4358 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:05.241527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:05.254862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:05.255496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:05.255774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:05.256045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:05.318906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:05.320324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:05.412924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 554/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:45:05.419009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:05.504124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:05.514230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72707-ff88-43ce-be3a-bed680d7eaf0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:05.546676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:05.547523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:05.547803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:05.548074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:05.549229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:05.550685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67298b-77bc-4dc4-8f1f-cd785f03bc09 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:05.552364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 562/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:05 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:05.558361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:05.578663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:05.651213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5f70-0a36-44b4-8d5f-e3f23a0c3745 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:05.683349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:05.683976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:05.684256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:05.684529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:05.685339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=dd98395828f54c959b6fb704371ec4db, user.id=22772d42bdec489da39bd5c66d07bcc2) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:05.685647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:05.687074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846c52-5af6-41d4-91cc-083d1a7a6b28 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:05.692226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 555/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:05 2022] GET /identity/v3/role_assignments?user.id=22772d42bdec489da39bd5c66d07bcc2&scope.project.id=dd98395828f54c959b6fb704371ec4db&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:07.674923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c405139-f1a3-4a7f-8f29-0e55aaf1c8b9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:07.675477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c405139-f1a3-4a7f-8f29-0e55aaf1c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:07.675477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c405139-f1a3-4a7f-8f29-0e55aaf1c8b9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:07.676829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 563/1118] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:07.681915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:07.682403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:07.683076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:07.699282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:07.700464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:07.765051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 556/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:07.787111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c405139-f1a3-4a7f-8f29-0e55aaf1c8b9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:07.883222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c405139-f1a3-4a7f-8f29-0e55aaf1c8b9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:07.915191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:07.916033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:07.916317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:07.916593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] PATH_INFO: `/v3/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:07.918563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] RBAC: Authorizing `identity:get_role(role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:07.919924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:07.921324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 564/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:07 2022] GET /identity/v3/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:07.927041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:07.942028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:08.023819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b3ee-9e0e-4f8f-9348-19c4db1f528e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:08.059930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:08.061485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:08.062019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:08.062583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] PATH_INFO: `/v3/users/22772d42bdec489da39bd5c66d07bcc2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:08.064790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] RBAC: Authorizing `identity:get_user(user_id=22772d42bdec489da39bd5c66d07bcc2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:08.067615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:08.070806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 557/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:07 2022] GET /identity/v3/users/22772d42bdec489da39bd5c66d07bcc2 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:08.076657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:08.104266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:08.177582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515ed2e-192d-453a-aa00-020ac66c85dd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:08.210504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:08.211596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:08.211877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:08.212151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:08.213316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:08.215443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ab85-8fb9-48d3-938c-e268713d0e24 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:08.217162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 565/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:08 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:08.223127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:08.309607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:08.331281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdf74-7493-4cb4-bf91-749a123efaf9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:08.366384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:08.367256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:08.367538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:08.367809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db/users/22772d42bdec489da39bd5c66d07bcc2/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:08.370064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=dd98395828f54c959b6fb704371ec4db, user_id=22772d42bdec489da39bd5c66d07bcc2, role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:08.371509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb719-7ddf-419f-86db-fb97bf781cfd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:08.384231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 558/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:45:08 2022] PUT /identity/v3/projects/dd98395828f54c959b6fb704371ec4db/users/22772d42bdec489da39bd5c66d07bcc2/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:10.369916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696c56-4ee2-427b-9542-7b6ff8771f4d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.370461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696c56-4ee2-427b-9542-7b6ff8771f4d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.370461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696c56-4ee2-427b-9542-7b6ff8771f4d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.371800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 566/1124] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:10.376849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.377276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.377390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.393577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:10.394788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:10.458313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 559/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:45:10.482359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1696c56-4ee2-427b-9542-7b6ff8771f4d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.572554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:10.580413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1696c56-4ee2-427b-9542-7b6ff8771f4d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.613084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.613925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.614242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.614523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] PATH_INFO: `/v3/roles/0d6bfd102cfb457d9758dde63c5fd745` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.615987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] RBAC: Authorizing `identity:get_role(role_id=0d6bfd102cfb457d9758dde63c5fd745)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.617334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.618719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 567/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:10 2022] GET /identity/v3/roles/0d6bfd102cfb457d9758dde63c5fd745 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:10.624349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.690632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:10.720049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c012-c3d4-4590-a3e5-b8b6614c6a73 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.751461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.752320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.752601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.752876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] PATH_INFO: `/v3/users/22772d42bdec489da39bd5c66d07bcc2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.754080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] RBAC: Authorizing `identity:get_user(user_id=22772d42bdec489da39bd5c66d07bcc2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.755526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.757127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 560/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:10 2022] GET /identity/v3/users/22772d42bdec489da39bd5c66d07bcc2 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:10.764286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.860819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532a92c-bd9e-485f-80b7-77c79ff11b4c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.894225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.894805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.895091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.895367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.924687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:10.962936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.965011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.067724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 568/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:45:11.075406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:11.170391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd5a7-6fe8-4f7b-87ab-5998f0b2d770 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:11.203921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:11.204798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.205107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.205408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] PATH_INFO: `/v3/projects/dd98395828f54c959b6fb704371ec4db` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.206600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] RBAC: Authorizing `identity:get_project(project_id=dd98395828f54c959b6fb704371ec4db)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:11.208015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dcc24-8158-44ab-9b67-107657ab2613 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.209701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 561/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:11 2022] GET /identity/v3/projects/dd98395828f54c959b6fb704371ec4db => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:11.216026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:11.282912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:11.320109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d52f-7512-40bd-b67a-973098fe8795 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:11.352113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:11.352751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.353032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.353305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.354144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] RBAC: Adding query filter params (role.id=0d6bfd102cfb457d9758dde63c5fd745, scope.project.id=dd98395828f54c959b6fb704371ec4db, user.id=22772d42bdec489da39bd5c66d07bcc2) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:11.355059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:11.356467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232be50-637f-4c52-ab43-b5f410b79cff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.362067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 569/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:11 2022] GET /identity/v3/role_assignments?user.id=22772d42bdec489da39bd5c66d07bcc2&scope.project.id=dd98395828f54c959b6fb704371ec4db&role.id=0d6bfd102cfb457d9758dde63c5fd745 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:13.362072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6d83-eafc-4118-947c-1de3515f92d1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.362587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6d83-eafc-4118-947c-1de3515f92d1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.362587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6d83-eafc-4118-947c-1de3515f92d1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.363946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 562/1131] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:13.369143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.369546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.369696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.386915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:13.388083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:13.450538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 570/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:13.472843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff6d83-eafc-4118-947c-1de3515f92d1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:13.483415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:13.569793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff6d83-eafc-4118-947c-1de3515f92d1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:13.601862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:13.602553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.602898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.603264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.604948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:13.606381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37805b4e-0751-430c-8c74-0c324d1a9e69 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:13.607972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 563/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:13.613906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:13.667135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:13.708600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f7b9-dc8f-49b4-b5ce-29b15323b6f2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:13.740739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:13.741387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.741667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.741939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.742680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:13.744083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480326b-8655-4ed9-a23e-e072e22fb58a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:13.767922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 571/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:45:13 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:15.786809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3bbd-ebf0-4e83-b925-a6a09add679f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:15.787353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3bbd-ebf0-4e83-b925-a6a09add679f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:15.787353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b3bbd-ebf0-4e83-b925-a6a09add679f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:15.788729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 564/1135] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:15.794724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:15.795156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:15.795285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:15.811583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:15.812759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:15.876784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 572/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:15.901909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b3bbd-ebf0-4e83-b925-a6a09add679f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:15.974738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:15.997158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b3bbd-ebf0-4e83-b925-a6a09add679f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:16.029472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:16.030278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:16.030556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:16.030825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:16.031984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:16.033393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d8242-7ab2-4ec2-92ad-8d8c672cc94e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:16.035002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 565/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:45:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:16.040982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:16.079346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:16.139280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0183d62-83f6-450f-9d2c-66336396ada9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:16.171913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:16.172571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:16.172854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:16.173128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:16.173829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:16.175279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3fc93-4c68-4f29-81c1-f4ca4be25402 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:16.194218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 573/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:45:16 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:18.227921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ed32-45ee-4407-a059-b10d03b56274 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.228422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ed32-45ee-4407-a059-b10d03b56274 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.228533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ed32-45ee-4407-a059-b10d03b56274 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.230384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 566/1139] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:18.235452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.235844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.236003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.252694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:18.253859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:18.316285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 574/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:18.338511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ed32-45ee-4407-a059-b10d03b56274 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.436428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ed32-45ee-4407-a059-b10d03b56274 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.468615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.469395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.469680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.469957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.480315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:18.487947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:18.489174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:18.490306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 567/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:18.494979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.518430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:18.590706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2ec58-3cb0-49e1-b10d-4f7537381799 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.623085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.623744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.624031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.624313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.625054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:18.625365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.626751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.634505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 575/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:18.640056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.643802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:18.737225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec219d2-4f1d-4a79-91c8-fb34983b6299 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.768913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.769770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.770055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.770361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] PATH_INFO: `/v3/users/9d22c3d23b3f4114907dd2876e7f2467` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.784132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=9d22c3d23b3f4114907dd2876e7f2467)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.785563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.787220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 568/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:18 2022] GET /identity/v3/users/9d22c3d23b3f4114907dd2876e7f2467 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:18.793629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.877302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:18.892486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b203a1-e373-42d7-941b-dc10fbb7f0ef None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.924897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.925536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.925821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.926101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.990076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.991477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.070557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:19.086605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 576/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:45:19.092858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.151461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:19.187521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af084-6326-489b-be4a-40239070b9a3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.219974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.220822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.221103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.221376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] PATH_INFO: `/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.222572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] RBAC: Authorizing `identity:get_project(project_id=80dd03ae88b84d9f8d8a9a98af34e7e7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.223986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934425-6ef3-4eaf-b68e-1fc227467134 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.225666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 569/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:19 2022] GET /identity/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:19.231768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.326782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855f50a-6408-4657-9afe-53f0732cf3d8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.359008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.359646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.359927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.360201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.361022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=80dd03ae88b84d9f8d8a9a98af34e7e7, user.id=9d22c3d23b3f4114907dd2876e7f2467) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:19.361332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.362764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776227e-5b25-46a7-95fc-9857ec959112 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.367943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 577/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:19 2022] GET /identity/v3/role_assignments?user.id=9d22c3d23b3f4114907dd2876e7f2467&scope.project.id=80dd03ae88b84d9f8d8a9a98af34e7e7&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:21.341288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831e97-433b-4f01-8187-f50de21d4ee3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.341793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831e97-433b-4f01-8187-f50de21d4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.341879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83831e97-433b-4f01-8187-f50de21d4ee3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.343259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 570/1147] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:21.348480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202b17-0830-4044-89ac-d037252452c1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.348913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202b17-0830-4044-89ac-d037252452c1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.349039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202b17-0830-4044-89ac-d037252452c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.365750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-53202b17-0830-4044-89ac-d037252452c1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:21.366896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-53202b17-0830-4044-89ac-d037252452c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:21.410079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:21.430788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 578/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:21.453301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83831e97-433b-4f01-8187-f50de21d4ee3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:21.550844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83831e97-433b-4f01-8187-f50de21d4ee3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:21.577391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:21.583460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:21.584241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.584527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.584804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.595124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:21.602783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:21.603919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:21.605314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 571/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:21.610499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202b17-0830-4044-89ac-d037252452c1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:21.706303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202b17-0830-4044-89ac-d037252452c1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:21.738828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:21.739480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.739761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.740034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.740766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:21.741070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:21.742451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:21.750149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 579/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:21.755734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:21.856867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329a31-e1e9-453b-a1c6-8c3ffac3274d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:21.888682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:21.889553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.889838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.890131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] PATH_INFO: `/v3/users/9d22c3d23b3f4114907dd2876e7f2467` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.891329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] RBAC: Authorizing `identity:get_user(user_id=9d22c3d23b3f4114907dd2876e7f2467)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:21.892753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:21.894409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 572/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:21 2022] GET /identity/v3/users/9d22c3d23b3f4114907dd2876e7f2467 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:21.900054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:21.941673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:21.996053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83fc1-50af-4f9c-a349-fca253bed07b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:22.028487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:22.029337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:22.029620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:22.029902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] PATH_INFO: `/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:22.031088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] RBAC: Authorizing `identity:get_project(project_id=80dd03ae88b84d9f8d8a9a98af34e7e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:22.032496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e5f9a-87f3-4f19-85bf-7f1b22322518 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:22.034206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 580/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:21 2022] GET /identity/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:22.040226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:22.095238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:22.134625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979347-1e6d-4600-85b1-f9141947490d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:22.166841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:22.167713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:22.167989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:22.168258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] PATH_INFO: `/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7/users/9d22c3d23b3f4114907dd2876e7f2467/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:22.170192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dd03ae88b84d9f8d8a9a98af34e7e7, user_id=9d22c3d23b3f4114907dd2876e7f2467, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:22.171600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa88be-f231-45b7-b1b1-d1caf989cf67 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:22.183908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 573/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:45:22 2022] PUT /identity/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7/users/9d22c3d23b3f4114907dd2876e7f2467/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:24.160193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712d95-4d62-4556-99d0-42052ed96b14 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.160639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712d95-4d62-4556-99d0-42052ed96b14 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.160753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712d95-4d62-4556-99d0-42052ed96b14 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.162136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 581/1154] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:24.168088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.168499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.168654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.185483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:24.186704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:24.250292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 574/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:24.272980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712d95-4d62-4556-99d0-42052ed96b14 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:24.370468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23712d95-4d62-4556-99d0-42052ed96b14 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:24.380047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:24.402617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:24.403382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.403664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.403934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.413899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:24.422283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:24.423355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:45:24.424245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 582/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:24.429178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:24.475858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:24.524726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76791-bc47-4fef-8a67-2893f3d107ba None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:24.558308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:24.558964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.559271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.559525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.560256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:24.560566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:24.561922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:24.569632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 575/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:24.575269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:24.671801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d765-34c7-4a0b-bbe1-90405adcfa93 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:24.704667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:24.705521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.705806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.706085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] PATH_INFO: `/v3/users/9d22c3d23b3f4114907dd2876e7f2467` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.707296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] RBAC: Authorizing `identity:get_user(user_id=9d22c3d23b3f4114907dd2876e7f2467)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:24.708716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:24.710357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 583/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:24 2022] GET /identity/v3/users/9d22c3d23b3f4114907dd2876e7f2467 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:24.715765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:24.811050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd01c-78aa-41e7-ac88-21bdaeb0b94a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:24.820734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:24.843804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:24.844436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:24.844722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:24.845000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:24.909259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:24.910725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:25.004892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 576/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:45:25.010608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:25.049979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:25.107285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d6f3-6f2c-49a9-9190-96d218ee3437 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:25.139968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:25.140819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:25.141101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:25.141373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] PATH_INFO: `/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:25.142571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] RBAC: Authorizing `identity:get_project(project_id=80dd03ae88b84d9f8d8a9a98af34e7e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:25.143982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360e2b0-9c8f-45b7-9130-1d9838305f02 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:25.145673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 584/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:25 2022] GET /identity/v3/projects/80dd03ae88b84d9f8d8a9a98af34e7e7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:25.151613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:25.162721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:25.246051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530c1b7-fa62-423f-b899-e83b41080377 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:25.278032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:25.278707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:25.278994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:25.279273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:25.280102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=80dd03ae88b84d9f8d8a9a98af34e7e7, user.id=9d22c3d23b3f4114907dd2876e7f2467) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:25.280415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:25.281835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08586c-f204-4c90-afa5-d441db0c36d0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:25.287473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 577/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:25 2022] GET /identity/v3/role_assignments?user.id=9d22c3d23b3f4114907dd2876e7f2467&scope.project.id=80dd03ae88b84d9f8d8a9a98af34e7e7&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:27.280680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7b32-8366-48cd-b920-2ed43dc61d92 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.281206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7b32-8366-48cd-b920-2ed43dc61d92 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.281206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7b32-8366-48cd-b920-2ed43dc61d92 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.282615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 585/1162] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:27.287604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.287969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.288157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.304915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:27.306088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:27.369239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 578/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:27.391142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7b32-8366-48cd-b920-2ed43dc61d92 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.487737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7b32-8366-48cd-b920-2ed43dc61d92 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:27.494589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:27.519862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:27.520485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.520762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.521050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.583815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:27.585236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:27.677449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 586/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:45:27.683288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.686305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:27.775290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06d84-d583-4cba-8c9d-29ea2b4e3cbd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:27.807717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:27.808496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.808776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.809048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.815365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:27.816792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4a61ff5e-236d-4ec3-83d4-e9f5243a3102 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:27.836912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:27.838609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:27.839486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 579/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:45:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:27.844412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.852438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:27.939481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e754a-0258-4442-99c9-576f79d24956 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:27.972383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:27.973032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.973315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.973591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.974325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:27.974632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:27.975975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f149acd-3760-4b9e-a89a-a58e8eba5dd6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:27.982903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 587/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Jul 13 08:45:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:29.963068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f73-b20e-41e9-af04-2ff8abac1dc6 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:29.963652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f73-b20e-41e9-af04-2ff8abac1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:29.963652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985f73-b20e-41e9-af04-2ff8abac1dc6 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:29.965035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 580/1167] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:29.969988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e56-991b-4f7b-b91a-37465ab51c50 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:29.970481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e56-991b-4f7b-b91a-37465ab51c50 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:29.970576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e56-991b-4f7b-b91a-37465ab51c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:29.986753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f5c97e56-991b-4f7b-b91a-37465ab51c50 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:29.987928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f5c97e56-991b-4f7b-b91a-37465ab51c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:30.050980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:30.055658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 588/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:30.078804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985f73-b20e-41e9-af04-2ff8abac1dc6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:30.140243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:30.177610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985f73-b20e-41e9-af04-2ff8abac1dc6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:30.209779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:30.210458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:30.210759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:30.211023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:30.211769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:30.213198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8548e27-8f04-4052-8c02-fba27e950a24 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:30.226755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 581/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Jul 13 08:45:30 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:32.238273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34382cd-8d1a-4ca6-93c8-0fa94d02a2cf None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.238829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34382cd-8d1a-4ca6-93c8-0fa94d02a2cf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.238829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34382cd-8d1a-4ca6-93c8-0fa94d02a2cf None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.240192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 589/1170] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:32.245754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8403-53e0-4077-85d2-be552395808f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.246231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8403-53e0-4077-85d2-be552395808f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.246353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd8403-53e0-4077-85d2-be552395808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.262510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-79bd8403-53e0-4077-85d2-be552395808f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:32.263696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-79bd8403-53e0-4077-85d2-be552395808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:32.326952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 582/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:32.350375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34382cd-8d1a-4ca6-93c8-0fa94d02a2cf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.448017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34382cd-8d1a-4ca6-93c8-0fa94d02a2cf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.480757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.481603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.481886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.482187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] PATH_INFO: `/v3/domains/d4f533dd77084b2b9def7b7f6d9c7796` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.492244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d4f533dd77084b2b9def7b7f6d9c7796)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.493706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc233519-0511-45d7-a5d4-ad13ced164b7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.495348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 590/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Jul 13 08:45:32 2022] GET /identity/v3/domains/d4f533dd77084b2b9def7b7f6d9c7796 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:32.500991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd8403-53e0-4077-85d2-be552395808f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.553345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:32.596811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd8403-53e0-4077-85d2-be552395808f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.628276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.628922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.629206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.629508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.630374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.631792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731907e-3bdc-483e-8d1d-6925801a7c06 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.657817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 583/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:45:32 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:34.679722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9f1e-5721-4a7c-a917-81909c30535d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:34.680264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9f1e-5721-4a7c-a917-81909c30535d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:34.680264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9f1e-5721-4a7c-a917-81909c30535d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:34.681708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 591/1174] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:34.687577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:34.687948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:34.688141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:34.704332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:34.705518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:34.768392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 584/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:34.793188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c9f1e-5721-4a7c-a917-81909c30535d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:34.850707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:34.890608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c9f1e-5721-4a7c-a917-81909c30535d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:34.922133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:34.922984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:34.923264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:34.923535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] PATH_INFO: `/v3/domains/d4f533dd77084b2b9def7b7f6d9c7796` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:34.924682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=d4f533dd77084b2b9def7b7f6d9c7796)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:34.926079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e89fb-12be-48b3-849e-d28157ccbfdf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:34.927698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 592/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Jul 13 08:45:34 2022] GET /identity/v3/domains/d4f533dd77084b2b9def7b7f6d9c7796 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:34.933772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:34.967605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:35.028752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f329e-7ff3-4f8c-9fba-5bb023480ea5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:35.061124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:35.061778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:35.062059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:35.062362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:35.063049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:35.064456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e78bb-7cf2-4897-9234-77188f806a48 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:35.083190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 585/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:45:34 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:37.112507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e651-eb02-4e1a-9e51-26acfc8fef78 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.112883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e651-eb02-4e1a-9e51-26acfc8fef78 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.113064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e651-eb02-4e1a-9e51-26acfc8fef78 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.114484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 593/1178] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:37.120278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.120653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.120842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.137065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:37.138290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:37.202849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 586/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:37.226300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e651-eb02-4e1a-9e51-26acfc8fef78 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:37.323537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e651-eb02-4e1a-9e51-26acfc8fef78 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:37.348067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:37.356386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:37.357161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.357445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.357719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.368139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:37.375572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:37.376712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:45:37.377937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 594/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:37.382625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:37.405336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:37.481780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b478e-38d8-4b71-8607-ed970814fdee None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:37.513201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:37.513851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.514155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.514435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.515168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:37.515473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:37.516825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:37.524484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 587/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:37.530661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:37.624733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520ff9c-786e-4f1f-b92a-b45d11d09d05 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:37.656831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:37.657678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.657956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.658260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] PATH_INFO: `/v3/users/00b785a6582e44d6b0d5a67a2b419922` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.670836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] RBAC: Authorizing `identity:get_user(user_id=00b785a6582e44d6b0d5a67a2b419922)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:37.672248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:37.673846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 595/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:37 2022] GET /identity/v3/users/00b785a6582e44d6b0d5a67a2b419922 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:37.679375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:37.757986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:37.773594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6d842-930b-412d-a43c-6b9aad7aaeb5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:37.805282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:37.805909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.806215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.806512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.874484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:37.875966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:37.953209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:37.969996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 588/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:45:37.975782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:38.020240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:38.077766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce505-528a-4e12-94da-d12d275d1d6e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:38.109594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:38.110474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:38.111214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:38.111214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] PATH_INFO: `/v3/projects/2cd03ced05f546a886f52106504e547d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:38.112161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] RBAC: Authorizing `identity:get_project(project_id=2cd03ced05f546a886f52106504e547d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:38.113578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204712af-b015-4adb-a7a5-bc3b0ae9408d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:38.115304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 596/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:37 2022] GET /identity/v3/projects/2cd03ced05f546a886f52106504e547d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:38.121732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:38.215295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ace89f-f15b-4582-bcc2-77285713ce2b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:38.247279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:38.247913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:38.248193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:38.248466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:38.249276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=2cd03ced05f546a886f52106504e547d, user.id=00b785a6582e44d6b0d5a67a2b419922) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:38.249584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:38.251018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ab3b-11a1-4834-8a79-c49acf0fd51c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:38.256259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 589/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:38 2022] GET /identity/v3/role_assignments?user.id=00b785a6582e44d6b0d5a67a2b419922&scope.project.id=2cd03ced05f546a886f52106504e547d&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:40.206272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018369-83af-4464-aa4a-eeaa60ecb884 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.206786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018369-83af-4464-aa4a-eeaa60ecb884 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.206879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018369-83af-4464-aa4a-eeaa60ecb884 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.208268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 597/1186] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:40.213986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.214443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.214577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.231381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:40.232546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:40.272861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:40.296479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 590/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:45:40.318384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018369-83af-4464-aa4a-eeaa60ecb884 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:40.426994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018369-83af-4464-aa4a-eeaa60ecb884 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:40.440847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:40.459563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:40.460328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.460607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.460876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.470925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:40.478958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:40.480042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:45:40.481267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 598/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:40.486133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:40.579061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbbf04-e75b-42e1-98d2-5db1ce89e9e9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:40.611434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:40.612093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.612378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.612655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.613390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:40.613697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:40.615085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:40.622783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 591/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:40.628322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:40.724050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d472f-aa0a-4c7b-845d-f271e6d85988 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:40.755165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:40.756019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.756299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.756569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] PATH_INFO: `/v3/users/00b785a6582e44d6b0d5a67a2b419922` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.757737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] RBAC: Authorizing `identity:get_user(user_id=00b785a6582e44d6b0d5a67a2b419922)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:40.759177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:40.761328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 599/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:40 2022] GET /identity/v3/users/00b785a6582e44d6b0d5a67a2b419922 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:40.766917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:40.807088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:40.862599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab06-484e-4996-a7d2-8198fc225cbb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:40.894868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:40.895710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:40.895995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:40.896272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] PATH_INFO: `/v3/projects/2cd03ced05f546a886f52106504e547d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:40.897433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2cd03ced05f546a886f52106504e547d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:40.898868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16271f52-f5af-4a12-93e9-de679e19a0a5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:40.901121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 592/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:40 2022] GET /identity/v3/projects/2cd03ced05f546a886f52106504e547d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:40.907033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:40.948655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:41.003926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b4c99-b598-4424-8ca4-4c3d1c7f375b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:41.035800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:41.036671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:41.036953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:41.037228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] PATH_INFO: `/v3/projects/2cd03ced05f546a886f52106504e547d/users/00b785a6582e44d6b0d5a67a2b419922/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:41.039175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd03ced05f546a886f52106504e547d, user_id=00b785a6582e44d6b0d5a67a2b419922, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:41.040870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8404b3-eb08-4527-9c03-27fd96145b6d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:41.053218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 600/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:45:40 2022] PUT /identity/v3/projects/2cd03ced05f546a886f52106504e547d/users/00b785a6582e44d6b0d5a67a2b419922/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:43.022707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0b8b-db03-4238-adb4-74bd5c77098c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.023228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0b8b-db03-4238-adb4-74bd5c77098c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.023339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0b8b-db03-4238-adb4-74bd5c77098c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.024623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 593/1193] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:45:43.030298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.030682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.030860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.047372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:43.048555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:43.112185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 601/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:45:43.135780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0b8b-db03-4238-adb4-74bd5c77098c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:43.232978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0b8b-db03-4238-adb4-74bd5c77098c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:43.241591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:43.266550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:43.267324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.267607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.267883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.277607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:45:43.285154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:45:43.286255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:45:43.287099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 594/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:45:43.292473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:43.322612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:43.389508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcd8c0-3208-497d-ae97-366d791e6e42 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:43.421746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:43.422424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.422707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.422981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.423709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:43.424009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:43.425352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:43.433570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 602/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:43.439170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:43.535170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3889f4-e2df-4e96-acbe-737905e81d63 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:43.567464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:43.568323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.568612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.568889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] PATH_INFO: `/v3/users/00b785a6582e44d6b0d5a67a2b419922` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.570065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] RBAC: Authorizing `identity:get_user(user_id=00b785a6582e44d6b0d5a67a2b419922)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:43.571512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:43.573175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 595/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Jul 13 08:45:43 2022] GET /identity/v3/users/00b785a6582e44d6b0d5a67a2b419922 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:43.578787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:43.667976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:43.674896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24d40-55c9-4a4f-8a99-2ee2f497bf4e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:43.706896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:43.707523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:43.707803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:43.708073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:43.773112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:43.774573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:43.861939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:43.869499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 603/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:45:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 08:45:43.875263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:43.909552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:43.971777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8f483-2f96-4549-98fc-7f4f68526a8a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:44.003850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:44.004705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:44.004991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:44.005271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] PATH_INFO: `/v3/projects/2cd03ced05f546a886f52106504e547d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:44.006461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] RBAC: Authorizing `identity:get_project(project_id=2cd03ced05f546a886f52106504e547d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:44.007903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95570595-c1d9-4130-9f3b-5bf5f4db0604 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:44.010323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 596/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Jul 13 08:45:43 2022] GET /identity/v3/projects/2cd03ced05f546a886f52106504e547d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:44.016259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:44.111245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388f8f-6c5a-422e-a2f9-e07e326bd5e0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:44.145262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:44.145851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:44.146164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:44.146445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:44.147264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=2cd03ced05f546a886f52106504e547d, user.id=00b785a6582e44d6b0d5a67a2b419922) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:44.147575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:44.148982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39dc1e-2014-49d2-a09e-49d1e52b234f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:44.154734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 604/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:45:44 2022] GET /identity/v3/role_assignments?user.id=00b785a6582e44d6b0d5a67a2b419922&scope.project.id=2cd03ced05f546a886f52106504e547d&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:53.999813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=48 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:45:54.152071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=71 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:38.667214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300703-e4cc-4721-bf09-261d7bec9250 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:38.667801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300703-e4cc-4721-bf09-261d7bec9250 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:38.667801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3300703-e4cc-4721-bf09-261d7bec9250 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:38.669314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 597/1201] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:38.674583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:38.675084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:38.675199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:38.691852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:38.693040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:38.772121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 605/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:38.800532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3300703-e4cc-4721-bf09-261d7bec9250 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:38.928279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3300703-e4cc-4721-bf09-261d7bec9250 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:38.972624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:38.973429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:38.973715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:38.973986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:38.985240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:38.986728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:39.005232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:39.006650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:39.007801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:39.007801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:39.007801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:39.007801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:39.007801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 598/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:46:39.014855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:39.139731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46273402-27dd-4958-ae3b-d65f3a7d7a5a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:39.171644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:39.179106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:39.180342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:39.180632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:39.180911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:39.181699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:39.181978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:39.183420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8348-286b-4b4e-b465-a4dfd9d54b6a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:39.196495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 606/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:39.201626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:39.267800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:39.327346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41285ed1-0dd9-4e3c-86ef-f3237e88bd62 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:39.372797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:39.373461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:39.373750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:39.374016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:39.374767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:39.376177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596d65-6502-470f-8937-0b8a2f138625 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:39.398445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 599/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Jul 13 08:46:39 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:46:41.614609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7603d-8173-4fc6-b28f-9cbd29358830 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:41.615177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7603d-8173-4fc6-b28f-9cbd29358830 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:41.615177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7603d-8173-4fc6-b28f-9cbd29358830 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:41.616716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 607/1206] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:41.622263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:41.622674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:41.622854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:41.640628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:41.642197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:41.724287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 600/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:41.749953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7603d-8173-4fc6-b28f-9cbd29358830 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:41.870764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7603d-8173-4fc6-b28f-9cbd29358830 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:41.913229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:41.914855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:41.915149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:41.915425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:41.929027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:46:41.939714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:41.940706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:41.947278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 608/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:46:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:41.948115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:41.997327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:42.070740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed4d8-3f9f-40d8-9524-d3d8422a85a1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:42.114938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:42.115661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:42.115945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:42.116219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:42.117018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:42.117311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:42.122410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:42.130524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 601/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:46:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:42.137293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:42.196079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:42.249760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624242a-51e0-446f-b395-262c32397dd6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:42.293417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:42.294701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:42.294995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:42.295272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:42.306817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:42.308251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:42.327181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:42.329190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:42.330102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:42.330102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:42.330102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:42.330102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:42.330102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 609/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:42.335066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:42.447629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:42.450809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3901817-59c4-409f-8b08-76590a5d48dc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:42.487698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:42.488256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:42.488543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:42.488800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:42.489516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:42.489815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:42.491201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:42.503523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 602/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:42.509965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:42.619550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9f58-ec19-4009-ad2d-1e72303d6ad3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:42.621152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:42.655506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:42.656337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:42.656601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:42.656925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:42.664709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:42.666342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:46:42.681776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:42.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:42.689478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 610/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:42.691643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:42.800123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a472-b5a3-44b0-89d9-e8904b0270c1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:42.836443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:42.837112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:42.837395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:42.837666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:42.838577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:42.838824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:42.840243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:42.858784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 603/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:46:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:42.864483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:42.989225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9145-237b-4c01-bda7-983e465f1128 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:43.026759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:43.027413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:43.027695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:43.027966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:43.064020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:43.105515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:43.108190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:43.230817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 611/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:46:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:46:43.236627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:43.259819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:43.368096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f59e9-95d9-452c-9017-80c3d6510949 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:43.407931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:43.408733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:43.409016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:43.409356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:43.422095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:43.424747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:43.442491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:43.443630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:43.444696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:43.444696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:43.444696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:43.444696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:43.444696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 604/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:43.449537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:43.530910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:43.576635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2502b-d1c0-4df6-aab1-0991f7700a94 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:43.615581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:43.616283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:43.616602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:43.616863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:43.617739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:43.618053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:43.619492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:43.632294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 612/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:43.638170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:43.712883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:43.745640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7de46-d0c1-40dc-aded-16df7abd102f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:43.786691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:43.787770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:43.788088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:43.788724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:43.797526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:43.799382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:46:43.816167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:43.817237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:43.823649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 605/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:43.824175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:43.939291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465a58-6f3e-43fe-8dcc-0a75aaefa031 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:43.966051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:43.980829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:43.981727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:43.982010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:43.982317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:43.983105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:43.983412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:43.984827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743847-b10c-473e-94e0-19150272f3c8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:43.998194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 613/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:44.003996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:44.115012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c5f-7cc2-4b50-815c-b1731edec911 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:44.148855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:44.156624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:44.157340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:44.157631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:44.157909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:44.158831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=4169e5c77cc24a36ba0c3955b7637afb) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:44.159148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:44.160621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c170-82cf-4288-8308-8df09fa7f8b4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:44.166760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 606/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:46:44 2022] GET /identity/v3/role_assignments?user.id=4169e5c77cc24a36ba0c3955b7637afb&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:46.233317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127f29-7b3e-4d24-80e9-6d85458ebf4c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:46.233842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127f29-7b3e-4d24-80e9-6d85458ebf4c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:46.233842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127f29-7b3e-4d24-80e9-6d85458ebf4c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:46.235256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 614/1220] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:46.240542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:46.240969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:46.241108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:46.257835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:46.259034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:46.334488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 607/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:46.359281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51127f29-7b3e-4d24-80e9-6d85458ebf4c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:46.465593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51127f29-7b3e-4d24-80e9-6d85458ebf4c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:46.501926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:46.502748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:46.503024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:46.503289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:46.513435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:46:46.521838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:46.522977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:46.524699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:46.529064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 615/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:46:46.530312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:46.637548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650bba-1846-4ed6-ba4d-36cebfcee3c8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:46.662380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:46.675590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:46.676266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:46.676550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:46.676827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:46.677567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:46.677872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:46.679283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:46.687172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 608/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:46.693328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:46.741874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:46.800826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83a84-2019-4905-bd2a-f3b620b6117a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:46.834988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:46.836326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:46.836611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:46.836899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:46.847307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:46.848760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:46.865414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:46.866509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:46.867675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:46.867675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:46.867675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:46.867675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:46.867675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 616/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:46:46.872784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:46.993369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097f147-0fae-4b10-8a19-a94dad71bb89 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.029950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.030711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.031032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.031353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.032141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:47.032447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.033802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.045632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 609/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:46:47.051426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:47.151272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:47.158914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe70d-1e7f-4675-9cb4-e7e775569a46 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.196200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.197010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.197298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.197576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.206608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.208342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:46:47.224373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:47.225431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:47.226462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 617/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:47.231755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:47.283311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:47.343061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfef1c-71e5-40b3-9064-da49d1423cb7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.378319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.378995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.379278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.379552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.380382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:47.380690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.382104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.400300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 610/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:47.405905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:47.511370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b049fb-bb93-416f-ae8c-ddb795c139d5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.547936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.548598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.548884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.549161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.560636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.562101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:47.580707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:47.581832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:47.582828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:47.582828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:47.582828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:47.582828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:47.582828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 618/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:47.588099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:47.695983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9884a9e-3c02-4a18-9a46-aee221913370 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.698539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:47.734665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.735328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.735609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.735882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.736592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:47.736900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.738284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.749695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 611/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:47.755847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:47.765092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:47.866896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbedae8-5c94-4266-8187-33f93b7f80a3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:47.908459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:47.909487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:47.909755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:47.910103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:47.919061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:47.920521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:46:47.934842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:47.935947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:47.937031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 619/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:47.942007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:48.049124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca8784-a934-4caa-9348-665cca6f90d7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:48.087127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:48.087787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:48.088069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:48.088332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:48.089122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:48.089429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:48.090884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a0911-e081-4728-9991-37050e482aeb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:48.104105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 612/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:48.110170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:48.184948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:48.224306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b82a6-2ced-4432-94c4-f39ea7269133 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:48.263445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:48.264368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:48.264654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:48.264931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/4169e5c77cc24a36ba0c3955b7637afb/roles/93233f8df513407186508b6223a04630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:48.279938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=4169e5c77cc24a36ba0c3955b7637afb, role_id=93233f8df513407186508b6223a04630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:48.281380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd03ebc-44f5-491d-89a4-fa787dbb0e9d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:48.294512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 620/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:46:48 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/4169e5c77cc24a36ba0c3955b7637afb/roles/93233f8df513407186508b6223a04630 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:50.429644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90189e-d58a-40ce-b7f0-8fd79ae1d890 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:50.430193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90189e-d58a-40ce-b7f0-8fd79ae1d890 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:50.430193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90189e-d58a-40ce-b7f0-8fd79ae1d890 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:50.431539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 613/1233] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:50.437137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:50.437637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:50.437734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:50.454588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:50.455793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:50.526611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 621/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:50.551725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90189e-d58a-40ce-b7f0-8fd79ae1d890 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:50.577024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:50.658433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90189e-d58a-40ce-b7f0-8fd79ae1d890 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:50.694672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:50.695916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:50.696197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:50.696492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:50.706137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:46:50.714377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:50.715381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:50.716242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 614/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Jul 13 08:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:50.721845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:50.770026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:50.826609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01c20-67cb-41c4-be71-cec1711d30dd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:50.861348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:50.862014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:50.862320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:50.862593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:50.863331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:50.863636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:50.864986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:50.873850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 622/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Jul 13 08:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:46:50.880328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:50.980594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:50.998248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3d4b-1db4-4832-ba18-a94dbe0e054f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:51.033977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:51.034938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:51.035258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:51.035560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:51.047073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:51.048644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:51.066232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:51.067547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:51.068504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:51.068504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:51.068504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:51.068504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:51.068504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 615/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:51.074380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:51.187704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7b0eb-d5b6-4806-942a-2820ace4847e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:51.197918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:51.224774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:51.225436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:51.225723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:51.225999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:51.227259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:51.227565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:51.228920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:51.240637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 623/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:46:51.246985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:51.344452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c9166-84b8-4551-94ad-9e81c10e04b1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:51.379113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:51.379865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:51.380145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:51.380427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:51.383569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:51.388726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:51.390430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:46:51.404668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:51.405900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:51.407083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:51.412285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 616/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:51.412437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:51.532101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa26640-9d76-4d2e-ac73-3e033ae0b287 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:51.568767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:51.569447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:51.569727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:51.570001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:51.570895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:51.571194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:51.572612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:51.591048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 624/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:46:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:51.596859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:51.704638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f138c-3f14-46a4-b5c1-bd9117fded62 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:51.742746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:51.743506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:51.743852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:51.744198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:51.810192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:51.818012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:51.819745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:51.937594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 617/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:46:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:46:51.943832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:51.973899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:52.059600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eda2cd-825b-4e4b-b5a4-25a2253b40f9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:52.095162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:52.095970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:52.096245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:52.096560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:52.107050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:52.108509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:52.125843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:52.126844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:52.127725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:52.127725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:52.127725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:52.127725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:52.127725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 625/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:52.133500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:52.228798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:52.235670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225f29-f152-49a1-a8cb-71a82b096c98 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:52.272910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:52.274408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:52.274531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:52.274833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:52.275724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:52.276181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:52.278248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:52.292746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 618/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:52.298601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:52.389932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:52.415267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c860-6b53-4dbc-b94f-d518ba39f423 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:52.453307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:52.454260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:52.454554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:52.454852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:52.462303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:52.463755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:46:52.478176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:52.479532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:52.480613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 626/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:52.485281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:52.593895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32529c5-df91-4035-b7f0-9937017dba14 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:52.630356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:52.631047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:52.631283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:52.631588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:52.632858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:52.633297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:52.635309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032f1c8-253c-4e1c-808b-142d5154944f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:52.653478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 619/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:46:52.654694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:52.770630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff4e0f-ede7-4849-9d5b-4e5d7b044e8c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:52.805788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:52.806473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:52.806757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:52.807037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:52.807870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] RBAC: Adding query filter params (role.id=93233f8df513407186508b6223a04630, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=4169e5c77cc24a36ba0c3955b7637afb) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:52.808175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:52.809602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ca288-b89a-4b49-95a3-ec1fbe9b03fb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:52.815685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 627/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:46:52 2022] GET /identity/v3/role_assignments?user.id=4169e5c77cc24a36ba0c3955b7637afb&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=93233f8df513407186508b6223a04630 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:54.894565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f99b0-d6eb-40d7-87fb-5ceca18d91dd None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:54.895099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f99b0-d6eb-40d7-87fb-5ceca18d91dd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:54.895244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f99b0-d6eb-40d7-87fb-5ceca18d91dd None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:54.896744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 620/1247] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:54.903426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:54.903953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:54.903953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:54.909064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:54.922886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:54.924202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:55.004814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 628/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:55.034149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f99b0-d6eb-40d7-87fb-5ceca18d91dd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:55.056280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:55.159281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f99b0-d6eb-40d7-87fb-5ceca18d91dd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:55.197460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:55.198398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:55.198702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:55.199069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:55.211081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:46:55.219546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:55.220904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:55.222009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 621/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:55.228567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:55.344923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68be79-63ce-4548-a1ff-3614f5aeeae2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:55.379872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:55.386504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:55.387187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:55.387474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:55.387750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:55.388543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:55.388802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:55.390180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:55.398462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 629/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:55.404210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:55.482745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:55.506834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28955022-f9fc-441c-a9f9-e3db6ba4bd88 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:55.540944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:55.541747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:55.542039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:55.542345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:55.553626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:55.555879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:55.579861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:55.580838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:55.581726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:55.581726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:55.581726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:55.581726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:55.581726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 622/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:55.587073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:55.693887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07214a56-2f6c-459a-9598-03fa850be3cf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:55.730279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:55.730699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:55.730980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:55.731255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:55.732069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:55.732409 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:55.733891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:55.747272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 630/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:55.753551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:55.861929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9001-e810-4ba5-8eac-476109e7b502 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:55.893152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:55.903066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:55.904183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:55.904539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:55.904921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:55.917421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:55.919770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:46:55.941309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:55.942616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:55.943749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 623/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:55.949694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:56.010772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:56.069149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe319-dff2-4780-b4dd-5a29848ab877 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:56.106261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:56.106968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:56.107225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:56.107531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:56.108352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:56.108658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:56.110134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:56.130470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 631/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:46:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:46:56.138360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:56.253683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4388c-2835-40bb-b545-06c3e93448b5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:56.290817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:56.291478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:56.291752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:56.292024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:56.355374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:56.371030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:56.372477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:56.483117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 624/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:46:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:46:56.484316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:56.596496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6df69-7d85-4d09-9277-5bad15232f12 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:56.611251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:56.634742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:56.635569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:56.635854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:56.636131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:56.650558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:56.652341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:56.670945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:56.672225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:56.673306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:56.673306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:56.673306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:56.673306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:56.673306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 632/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:46:56.677984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:56.769029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:56.782412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455310-d403-4ada-bc14-c93009cf7fab None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:56.815919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:56.816583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:56.816866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:56.817138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:56.817851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:56.818185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:56.819541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:56.831268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 625/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:56.838161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:56.955196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379080f9-2eb2-4c26-bbc0-ca688b0cbb93 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:56.993652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:56.994482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:56.994768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:56.995056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:57.001671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:57.003228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:46:57.018821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:57.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:46:57.020727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 633/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:57.026375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:57.139046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e68e7-823a-4bbd-92da-efea693d1ea6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:57.177523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:57.178244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:57.178624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:57.178926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:57.180375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:57.180683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:57.182429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ab61-90af-4d08-95fc-cd8844b1e7c0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:57.195717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 626/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:57.202011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:57.230838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:57.314422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300020e-fec8-4181-97cb-a2fe5a2c88a5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:57.349960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:57.350664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:57.351472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:57.351841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:57.352815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=4169e5c77cc24a36ba0c3955b7637afb) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:57.353134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:57.354890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaacac-323a-470a-914e-c150d09acedc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:57.367277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 634/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:46:57 2022] GET /identity/v3/role_assignments?user.id=4169e5c77cc24a36ba0c3955b7637afb&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:59.372826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc08c-020c-4c3c-8b22-266863b8c53c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:59.373324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc08c-020c-4c3c-8b22-266863b8c53c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:59.373324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc08c-020c-4c3c-8b22-266863b8c53c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:59.374685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 627/1261] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:46:59.379705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:59.380118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:59.380256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:59.397007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:59.398781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:59.462321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 635/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:46:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:46:59.484035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc08c-020c-4c3c-8b22-266863b8c53c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:59.494556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:59.580367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc08c-020c-4c3c-8b22-266863b8c53c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:59.612074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:59.612841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:59.613122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:59.613391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:59.623006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:46:59.630471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:59.631584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:59.633049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 628/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:59.638000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:59.656175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:59.733369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9af8-d19b-4b33-be2f-5f6724a642c8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:59.765665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:59.766338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:59.766620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:59.766892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:59.767619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:59.767920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:59.769262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:59.776893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 636/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:59.782329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:59.845278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:46:59.878252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794f3a2-aafd-4e7c-b428-d59233404752 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:59.921124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:59.922045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:59.922394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:59.922704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:59.934860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:59.936461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:46:59.955645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:46:59.956689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:46:59.957634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:46:59.957634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:46:59.957634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:46:59.957634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:46:59.957634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 629/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:46:59.963013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.040870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:00.059660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf97c6-1639-4d1e-8393-cdfb0f1856e9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.091184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.091826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.092105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.092379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.093081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:00.093384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.094760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.106402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 637/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:00.112166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.205988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734338e-d9fb-406d-a6fb-384f9499dc68 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.224053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:00.238369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.239149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.239429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.239701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.247287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.248705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:47:00.262323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:00.263438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:47:00.264793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 630/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:00.269081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.365198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f9d2-b57b-4d5c-a32f-e481613967f9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.397819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.398514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.398796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.399112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.399895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:00.400200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.401608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.409956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:00.419052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 638/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:00.424682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.517872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067607-c179-4229-8a89-9791113808d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.549917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.550711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.550993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.551267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.561156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.562607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:47:00.578927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:00.579870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:00.580765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:47:00.580765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:47:00.580765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:00.580765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:47:00.580765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 631/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:00.586039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.681237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560d8d9-f68d-4610-99e0-a2e3d6c9a1cb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.713636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.714306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.714588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.714862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.715567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:00.715870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.717205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.728582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 639/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:00.733988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.764914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:00.830278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315f06-3d1b-487d-b8c7-f8a1a0add442 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:00.862465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:00.863245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:00.863528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:00.863804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:00.870183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:00.871569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:47:00.886489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:00.888049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:47:00.888936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 632/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:00.893658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:00.954860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:00.994878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff0142-3d21-4bad-9265-71a6a899d3e9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:01.026891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:01.027539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:01.027821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:01.028094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:01.028865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:01.029169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:01.030672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655fdbf-2f68-4a6b-a30f-3e29aba005bb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:01.042348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 640/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:47:01.048199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:01.134230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:01.142912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660442d8-05e1-4772-ae42-5aa6ce3ef361 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:01.175125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:01.175997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:01.176275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:01.176546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] PATH_INFO: `/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/4169e5c77cc24a36ba0c3955b7637afb/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:01.178484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f6cec22d5b3470a9452bf1b2e442d6a, user_id=4169e5c77cc24a36ba0c3955b7637afb, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:01.179926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51249-4bf7-4dbb-a06e-4d691a08ce45 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:01.191526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 633/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Jul 13 08:47:01 2022] PUT /identity/v3/projects/7f6cec22d5b3470a9452bf1b2e442d6a/users/4169e5c77cc24a36ba0c3955b7637afb/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:47:03.183268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915a6c-239f-47c7-81ea-bcf1d1e9d2eb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.183730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915a6c-239f-47c7-81ea-bcf1d1e9d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.183816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55915a6c-239f-47c7-81ea-bcf1d1e9d2eb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.185198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 641/1274] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:03.190177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.190590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.190746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.206971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:03.208159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:03.271286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 634/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:47:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:47:03.294538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55915a6c-239f-47c7-81ea-bcf1d1e9d2eb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:03.391347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55915a6c-239f-47c7-81ea-bcf1d1e9d2eb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:03.407609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:03.424539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:03.425315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.425598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.425873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.436180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 08:47:03.443741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:03.444800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:03.445840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 642/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Jul 13 08:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:47:03.450688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:03.528536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:03.547284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5accf-e3d4-40a8-9759-995b72f46c37 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:03.578691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:03.579349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.579631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.579905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.580639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:03.580942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:03.582324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:03.590540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 635/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Jul 13 08:47:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:03.596111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:03.690882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082c77-e288-471f-b00d-d4e5222294b9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:03.722329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:03.723095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.723375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.723648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.734967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:03.736386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:47:03.752816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:03.753953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:03.755257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:47:03.755257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:47:03.755257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:03.755257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:03.758503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 643/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:03.759433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:03.860547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183134f-cff3-45a8-bd32-c3132623ff9f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:03.893964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:03.894696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:03.894985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:03.895271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:03.895991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:03.896304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:03.898381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:03.911555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 636/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:47:03.918054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:03.953215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.021296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f854-b9f0-46bb-8dac-9be063d16c42 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.053925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.054741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.055027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.055303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.062570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.064080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 08:47:04.078559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:04.079668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:04.080820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 644/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:47:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:47:04.086044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:04.090001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.182635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f798d-76c8-4b80-a325-48440d64881e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.215451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.216059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.216342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.216617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.217442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:04.217751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.219184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:04.235273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 637/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Jul 13 08:47:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:04.241088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:04.328784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.338563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ade8-a5aa-49fa-ada5-d0da22567b20 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.370916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.371547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.371831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.372107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.437716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.439213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:04.523343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.533501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 645/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Jul 13 08:47:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 08:47:04.539453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:04.597992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.635651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261bfa9-3ece-49d7-ad97-17db0f1d9673 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.667997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.668771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.669058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.669336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.679562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.680991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 08:47:04.697915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:04.698822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:04.699740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 08:47:04.699740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 08:47:04.699740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:47:04.699740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:47:04.699740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 638/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:04.704493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:04.799460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82578-b573-4ba6-a006-acdf1751528b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.832227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.832883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.833168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.833444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.834184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:04.834493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.835836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:04.846640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 646/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Jul 13 08:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:04.852649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:04.955337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af845-1d23-49d3-87d4-050d1c5c8620 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:04.969139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:04.989063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:04.989852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:04.990156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:04.990437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:04.996888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:04.998341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 08:47:05.011689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:05.012699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jul 13 08:47:05.013652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 639/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Jul 13 08:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:05.019015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:05.067776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:05.116862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbb99f-56ca-4194-8f31-e7b3c60d3275 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:05.149178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:05.149834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:05.150142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:05.150419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:05.151199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:05.151507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:05.152931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b44ee9-cf21-4dc0-9a92-ee921a841bdb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:05.165427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 647/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Jul 13 08:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:05.171504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:05.264176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe32385-bfd6-40ac-a2b4-517a7f9ee447 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:05.296287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:05.296917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:05.297196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:05.297470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:05.298307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] RBAC: Adding query filter params (role.id=e3ea2fe66d56423a93654b34570d047c, scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a, user.id=4169e5c77cc24a36ba0c3955b7637afb) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:05.298611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:05.300015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6effd-75ec-4b9d-933a-353369ee7de5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:05.305536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 640/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Jul 13 08:47:05 2022] GET /identity/v3/role_assignments?user.id=4169e5c77cc24a36ba0c3955b7637afb&scope.project.id=7f6cec22d5b3470a9452bf1b2e442d6a&role.id=e3ea2fe66d56423a93654b34570d047c => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:07.317658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804c8d-a32f-4d9f-ad53-b2515f9a19a2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:07.318215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804c8d-a32f-4d9f-ad53-b2515f9a19a2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:07.318215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804c8d-a32f-4d9f-ad53-b2515f9a19a2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:07.320268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 648/1288] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:07.325277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244eab-4897-472b-a963-65a8e136b12d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:07.325661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244eab-4897-472b-a963-65a8e136b12d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:07.325838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244eab-4897-472b-a963-65a8e136b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:07.342099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-42244eab-4897-472b-a963-65a8e136b12d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:07.343296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-42244eab-4897-472b-a963-65a8e136b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:07.371239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:07.406318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 641/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:47:07.427713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f804c8d-a32f-4d9f-ad53-b2515f9a19a2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:07.523903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f804c8d-a32f-4d9f-ad53-b2515f9a19a2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:07.533899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:07.557239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:07.558012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:07.558316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:07.558598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:07.559239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:07.560566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:07.572735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:07.573940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:07.575187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 649/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:47:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:07.579573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42244eab-4897-472b-a963-65a8e136b12d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:07.673264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42244eab-4897-472b-a963-65a8e136b12d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:07.706840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:07.707485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:07.707764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:07.708036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:07.708721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:07.709022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:07.710411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adeb949-6a79-4444-9707-c5f0cf6bd6f5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:07.715045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 642/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jul 13 08:47:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:07.720564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:07.815829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3bbc4-71d7-4a60-bcc0-56ce7ca5dff2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:07.846820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:07.847456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:07.847737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:07.848015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:07.848701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:07.849002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:07.850372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9019aca-4edd-45ff-a524-546964fff8ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:07.855141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 650/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jul 13 08:47:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:47:09.857058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be2e-43ff-4f80-8d7b-722246a3dc59 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:09.857613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be2e-43ff-4f80-8d7b-722246a3dc59 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:09.857613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be2e-43ff-4f80-8d7b-722246a3dc59 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:09.859000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 643/1293] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:09.864108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c5dd-211b-4809-a205-b77df150ebba None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:09.864541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c5dd-211b-4809-a205-b77df150ebba None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:09.864670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97c5dd-211b-4809-a205-b77df150ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:09.881818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ad97c5dd-211b-4809-a205-b77df150ebba None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:09.883058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ad97c5dd-211b-4809-a205-b77df150ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:09.914071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:09.955983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 651/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:47:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 08:47:09.979696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9be2e-43ff-4f80-8d7b-722246a3dc59 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:10.009833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:10.075921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9be2e-43ff-4f80-8d7b-722246a3dc59 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:10.107539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:10.108133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:10.108411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:10.108681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:10.109390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:10.110839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5b2c-3bb6-456b-810c-b39efb08359c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:10.124416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 644/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Jul 13 08:47:09 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:47:12.109368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9927d-193b-44f9-b44f-bd05fd54258c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.109915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9927d-193b-44f9-b44f-bd05fd54258c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.110009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9927d-193b-44f9-b44f-bd05fd54258c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.111435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 652/1296] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:12.117284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.117702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.117843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.134032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:12.135244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:12.204486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 645/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:47:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:47:12.227630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9927d-193b-44f9-b44f-bd05fd54258c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:12.325784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9927d-193b-44f9-b44f-bd05fd54258c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:12.358311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:12.359097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.359430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.359654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.360295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:12.361651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:12.373967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:12.375049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:12.375952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 653/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:47:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:12.381059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:12.398536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:12.477238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21b5c-b44c-4bba-8eff-bd281b60c28b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:12.509125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:12.509783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.510068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.510552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.511255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:12.511559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:12.512913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:12.517909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 646/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jul 13 08:47:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:12.524298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:12.555217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:12.621326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8be2b-3708-484a-ba91-f190b810154f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:12.653332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:12.653971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.654282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.654560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.655336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] RBAC: Adding query filter params (interface=public, service_id=efd59efb3e4f4ddeae684a8e28aba354, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:12.655648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:12.656995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851407-4168-4921-b59b-6f6546cea1b0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:12.661826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 654/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Jul 13 08:47:12 2022] GET /identity/v3/endpoints?service_id=efd59efb3e4f4ddeae684a8e28aba354&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:12.668197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:12.744506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:12.761779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e3e6-f70d-4035-b6be-25a331f39286 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:12.795141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:12.795796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:12.796080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:12.796357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:12.797031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:12.798403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96dbe9-da0b-4cce-935a-a92b073b0c58 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:12.805009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 647/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Jul 13 08:47:12 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:47:14.798349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d420f-9145-401f-9f78-c7442108e6ad None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:14.798878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d420f-9145-401f-9f78-c7442108e6ad None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:14.798992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d420f-9145-401f-9f78-c7442108e6ad None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:14.800277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 655/1302] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:14.805779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:14.806190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:14.806434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:14.823152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:14.824335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:14.887399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 648/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:47:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 08:47:14.909372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d420f-9145-401f-9f78-c7442108e6ad None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:15.001383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:15.009010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d420f-9145-401f-9f78-c7442108e6ad None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:15.040591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:15.041371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:15.041653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:15.041926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:15.042594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:15.043956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 08:47:15.056088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 08:47:15.057253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jul 13 08:47:15.058497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 656/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Jul 13 08:47:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:47:15.063171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:15.136772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:15.158869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec8e70-c46e-41d1-9473-69dd9a7fd00b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:15.191417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:15.192071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:15.192354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:15.192631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:15.193322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:47:15.193628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:15.195038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8b88f-54c5-4ab3-b8ba-8b4903ef902d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:15.199990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 649/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Jul 13 08:47:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:47:15.205613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:15.301142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d518-86ae-4141-bb3b-7b1a45438acc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:15.333384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:15.333961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:15.334272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:15.334548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:15.335315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:15.336665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b8744-e4d8-4d8f-831f-ea337f9b7dff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:15.354834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 657/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Jul 13 08:47:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:47:25.197419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=30 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:47:25.349881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:17.486373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bb0dc-63f3-4a31-8533-585fc3c4eb09 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:17.486801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bb0dc-63f3-4a31-8533-585fc3c4eb09 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:17.487006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bb0dc-63f3-4a31-8533-585fc3c4eb09 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:17.488553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 650/1307] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:17.495166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9738-bbd0-4282-9370-e385afe4e424 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:17.495588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9738-bbd0-4282-9370-e385afe4e424 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:17.495729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9738-bbd0-4282-9370-e385afe4e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:17.675213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-41fc9738-bbd0-4282-9370-e385afe4e424 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:17.678808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-41fc9738-bbd0-4282-9370-e385afe4e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:17.830214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 658/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:17.871608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:17.871900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:17.872451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:17.873876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 651/1309] 10.222.0.49 () {54 vars in 964 bytes} [Wed Jul 13 08:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:17.880866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9706a-e793-4972-a33a-fb4ce5a0d230 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:17.881314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9706a-e793-4972-a33a-fb4ce5a0d230 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:17.881605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9706a-e793-4972-a33a-fb4ce5a0d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:17.970509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-95a9706a-e793-4972-a33a-fb4ce5a0d230 None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:17.971728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-95a9706a-e793-4972-a33a-fb4ce5a0d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:17.993313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:18.051441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 659/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Jul 13 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:18.060140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:18.061875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:18.170472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb4561-8ee9-4edd-8970-fa1b23beb414 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:18.241238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:18.241888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:18.242200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:18.242478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:18.244108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:18.299665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:18.356078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:18.357424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b072d43-390b-4338-bf54-96210ad7887c service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:18.376383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 652/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:20.674523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:20.675050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:20.675138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:20.676467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 660/1312] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:20.681842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a445-fd14-488f-a533-96af392befc7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:20.682331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a445-fd14-488f-a533-96af392befc7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:20.682653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a445-fd14-488f-a533-96af392befc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:20.762804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4162a445-fd14-488f-a533-96af392befc7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:20.764405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4162a445-fd14-488f-a533-96af392befc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:20.878486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 653/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:20.918537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:20.920087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:21.025704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7341a-5390-445c-b9e9-f35948cb9dd0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:21.100862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:21.103954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:21.104814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:21.105207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:21.105719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:21.109041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:21.227014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:21.228603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310eeb5-d112-4928-94a7-1f8d41408dba service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:21.248281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 661/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:23.591414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:23.591960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:23.591960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:23.593330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 654/1315] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:23.598452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a331-627f-4931-983f-adb1b9db12ce None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:23.598820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a331-627f-4931-983f-adb1b9db12ce None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:23.598998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a331-627f-4931-983f-adb1b9db12ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:23.661686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7cc4a331-627f-4931-983f-adb1b9db12ce None None] MFA Rules not processed for user `46b2b84891824421b912165050c75b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:23.663185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7cc4a331-627f-4931-983f-adb1b9db12ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:23.714967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:23.759034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 662/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:23.797883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:23.799455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:23.809499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:23.903234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c509b-53ca-4db6-8c51-da6a9dd77421 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:23.974263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:23.974912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:23.975194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:23.975470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:23.977113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:24.037721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:24.082191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:24.083652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16b96-5611-4bde-9e07-2af0776003f4 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:24.101986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 655/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:26.628207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:26.628769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:26.628769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:26.630748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 663/1318] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:26.635914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596628-98e2-49c7-a5e0-ae84a5a4d52f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:26.636304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596628-98e2-49c7-a5e0-ae84a5a4d52f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:26.636474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596628-98e2-49c7-a5e0-ae84a5a4d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:26.699499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-18596628-98e2-49c7-a5e0-ae84a5a4d52f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:26.700740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-18596628-98e2-49c7-a5e0-ae84a5a4d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:26.794130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 656/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:26.833115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:26.834678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:26.944737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78053561-264a-4d44-9f78-7f085c929ebe None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:27.014903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:27.015547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:27.015830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:27.016103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:27.017741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:27.024954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:27.124475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:27.125945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a1e8c-8506-47e8-bd23-0cf87bd369cf service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:27.143479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 664/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:29.811093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031983f-5d00-4c77-bc06-070243a40106 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:29.811627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031983f-5d00-4c77-bc06-070243a40106 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:29.811752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031983f-5d00-4c77-bc06-070243a40106 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:29.813042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 657/1321] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:29.818927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32a9e-6b08-4064-b65b-7a290dedb71e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:29.819329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32a9e-6b08-4064-b65b-7a290dedb71e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:29.819481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32a9e-6b08-4064-b65b-7a290dedb71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:29.883123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06e32a9e-6b08-4064-b65b-7a290dedb71e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:29.884373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06e32a9e-6b08-4064-b65b-7a290dedb71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:29.946769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:29.989613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 665/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:48:30.042102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:30.042422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:30.042704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:30.044128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 658/1323] 10.222.0.49 () {54 vars in 964 bytes} [Wed Jul 13 08:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:30.050719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944591-0f4d-4fd1-b3fa-bdf212150a5e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:30.051008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944591-0f4d-4fd1-b3fa-bdf212150a5e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:30.051851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67944591-0f4d-4fd1-b3fa-bdf212150a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:30.132901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-67944591-0f4d-4fd1-b3fa-bdf212150a5e None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:30.134105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-67944591-0f4d-4fd1-b3fa-bdf212150a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:30.207973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 666/1324] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Jul 13 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:30.217059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:30.218635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:30.237976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:30.319945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace134fc-be6b-4e2b-8482-90ba4c35ee85 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:30.391404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:30.391951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:30.392234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:30.392504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:30.394160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:30.465057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:30.505165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:30.506649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9eaf9-4d89-4495-ad0a-c5348a5e99c2 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:30.525237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 659/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:48:32.831103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:32.831662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:32.831662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:32.833067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 667/1326] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:32.838156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9948-72da-4485-937e-55078bba4386 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:32.838912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9948-72da-4485-937e-55078bba4386 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:32.839201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9948-72da-4485-937e-55078bba4386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:32.904362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ce9e9948-72da-4485-937e-55078bba4386 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:32.905592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce9e9948-72da-4485-937e-55078bba4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:33.012539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 660/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:33.048308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:33.049845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:33.109475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:33.155066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271782d-e9c2-4e94-815f-1c96c2b880b2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:33.229412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:33.229988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:33.230306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:33.230583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:33.232213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:33.337760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:33.340568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:33.342693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdfa03-91e3-447a-a233-164b99441ec0 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:33.361235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 668/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:35.425120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:35.425623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:35.425727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:35.427638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 661/1329] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:35.432801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd861f-90c5-457a-a0f6-1a52d03832b0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:35.433213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd861f-90c5-457a-a0f6-1a52d03832b0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:35.433365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd861f-90c5-457a-a0f6-1a52d03832b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:35.496834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8cdd861f-90c5-457a-a0f6-1a52d03832b0 None None] MFA Rules not processed for user `46b2b84891824421b912165050c75b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:35.498074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8cdd861f-90c5-457a-a0f6-1a52d03832b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:35.610598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 669/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:35.655873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:35.657432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:35.689381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:35.760111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5963-2c48-4304-b442-4e574b2ed726 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:35.831164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:35.831744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:35.832023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:35.832805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:35.834459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:35.909095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:35.941565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:35.943023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0b88-3de3-4839-8d62-f18ba9453e8e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:35.961388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 662/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:38.388035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:38.388560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:38.388560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:38.389934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 670/1332] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:38.395000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d7748-1df1-4a9c-85be-ac58f304829f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:38.395404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d7748-1df1-4a9c-85be-ac58f304829f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:38.395583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d7748-1df1-4a9c-85be-ac58f304829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:38.458876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-309d7748-1df1-4a9c-85be-ac58f304829f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:38.460069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-309d7748-1df1-4a9c-85be-ac58f304829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:38.553462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 663/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:38.588214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:38.589796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:38.657383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:38.691362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca4f8-086e-4e02-84c2-ecdbf2692695 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:38.761789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:38.762461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:38.762743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:38.763015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:38.764651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:38.869046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:38.870507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb5c6-786b-45fa-823b-1c12fd746d3a service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:38.880079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:38.888451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 671/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:40.930415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:40.930968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:40.931093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:40.932375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 664/1335] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:40.937515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92728-a9cb-4566-9bb9-b8f926edf689 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:40.937936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92728-a9cb-4566-9bb9-b8f926edf689 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:40.938066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c92728-a9cb-4566-9bb9-b8f926edf689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:41.000644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-22c92728-a9cb-4566-9bb9-b8f926edf689 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:41.001835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-22c92728-a9cb-4566-9bb9-b8f926edf689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:41.093584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 672/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:41.132516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:41.134053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:41.174288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:41.236978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eba44-81cc-4b27-941f-c7e05f8bda02 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:41.307102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:41.307749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:41.308033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:41.308308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:41.309962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:41.390368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:41.416133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:41.417564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421ce4-d8e1-45bc-9865-59c4c694be0d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:41.435389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 665/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:43.904614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:43.905158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:43.905158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:43.906607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 673/1338] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:43.912665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37964eb-5c98-454d-a85c-1d0929b59780 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:43.913100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37964eb-5c98-454d-a85c-1d0929b59780 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:43.913225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37964eb-5c98-454d-a85c-1d0929b59780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:43.975285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d37964eb-5c98-454d-a85c-1d0929b59780 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:43.976476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d37964eb-5c98-454d-a85c-1d0929b59780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:44.069022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 666/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:44.104809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:44.106392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:44.180757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:44.208465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924315-d202-4132-8e6f-d4a7cd468e6c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:44.279829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:44.280496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:44.280780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:44.281057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:44.282714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:44.387467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:44.388892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a0494-d54c-4a2a-ae56-a800692d6c5e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:44.408754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 674/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:48.424516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:48.425031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:48.425031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:48.426449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 667/1341] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:48.431569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104f56-d657-4142-8574-0fe6e565585b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:48.432002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104f56-d657-4142-8574-0fe6e565585b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:48.432132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104f56-d657-4142-8574-0fe6e565585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:48.436429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:48.497571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-16104f56-d657-4142-8574-0fe6e565585b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:48.498805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-16104f56-d657-4142-8574-0fe6e565585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:48.592642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 675/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:48.630969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:48.632564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:48.680275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:48.735253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441ea4e-81e2-4b5a-aefb-00b725a5d146 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:48.807628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:48.808314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:48.808597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:48.808872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:48.810545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:48.904142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:48.920801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:48.922276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b636fb8-250e-4553-8e69-0564d7b82a41 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:48.939892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 668/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:51.571408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:51.572009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:51.572009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:51.573336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 676/1344] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:51.578970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db203-b032-4f0d-82b2-5b271b9f6472 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:51.579465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db203-b032-4f0d-82b2-5b271b9f6472 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:51.579690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db203-b032-4f0d-82b2-5b271b9f6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:51.648688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-334db203-b032-4f0d-82b2-5b271b9f6472 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:51.649929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-334db203-b032-4f0d-82b2-5b271b9f6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:51.744297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 669/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:48:51.780583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:51.782103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:51.867006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:51.884272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682cdf0-b8ab-4930-861d-dbac7f0fd0c6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:51.962579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:51.963231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:51.963514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:51.963784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:51.965427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:52.071234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:52.072660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb650cb-bedb-4f30-8eba-17110ea95374 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:52.090820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 677/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:48:56.027649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:56.028177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:56.028302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:56.029591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 670/1347] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:48:56.034786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb8d-cf74-4a11-acc0-044f54c31d6b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:56.035224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb8d-cf74-4a11-acc0-044f54c31d6b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:56.035481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb8d-cf74-4a11-acc0-044f54c31d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:56.049922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:56.101061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-51ebdb8d-cf74-4a11-acc0-044f54c31d6b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:48:56.102917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-51ebdb8d-cf74-4a11-acc0-044f54c31d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:56.226931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 678/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:48:56.265408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:56.267017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:56.328844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:56.377432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2285e3-b293-4854-bfcd-1fed023e2921 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:56.451452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:56.452112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:56.452393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:56.452670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:56.454390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:56.570615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:48:56.576335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:56.577821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c504ea-65e0-4390-b618-849d6f0b30ad service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:56.596723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 671/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:01.526512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7e36-fb71-4ec6-8944-e18404518a52 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:01.527035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7e36-fb71-4ec6-8944-e18404518a52 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:01.527128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7e36-fb71-4ec6-8944-e18404518a52 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:01.529079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 679/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:01.535116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d0d9-0f7d-4a73-ab57-8dba7c40be4d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:01.535503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d0d9-0f7d-4a73-ab57-8dba7c40be4d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:01.535671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d0d9-0f7d-4a73-ab57-8dba7c40be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:01.615036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e504d0d9-0f7d-4a73-ab57-8dba7c40be4d None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:01.616243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e504d0d9-0f7d-4a73-ab57-8dba7c40be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:01.743512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 672/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:05.792859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8379-bfae-4579-ae81-421ca78ae952 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:05.793398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8379-bfae-4579-ae81-421ca78ae952 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:05.793398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8379-bfae-4579-ae81-421ca78ae952 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:05.794805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 680/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:05.800854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06d3-3b83-4bfd-a8a0-8d032ad8ab53 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:05.801265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06d3-3b83-4bfd-a8a0-8d032ad8ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:05.801412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed06d3-3b83-4bfd-a8a0-8d032ad8ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:05.863951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:05.888550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-15ed06d3-3b83-4bfd-a8a0-8d032ad8ab53 None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:05.889770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-15ed06d3-3b83-4bfd-a8a0-8d032ad8ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:06.005749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 673/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:49:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:06.224973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=59 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:07.297949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de5bd-54bd-44d1-8269-022f1ffc148c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:07.297949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de5bd-54bd-44d1-8269-022f1ffc148c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:07.297949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de5bd-54bd-44d1-8269-022f1ffc148c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:07.299263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 681/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:07.304188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7ea9-1cd7-4a36-80ce-a1c9ba562696 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:07.304617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7ea9-1cd7-4a36-80ce-a1c9ba562696 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:07.304745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7ea9-1cd7-4a36-80ce-a1c9ba562696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:07.378786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-66fc7ea9-1cd7-4a36-80ce-a1c9ba562696 None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:07.379998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-66fc7ea9-1cd7-4a36-80ce-a1c9ba562696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:07.421448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:07.487164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 674/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:49:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:11.070502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a104ad-ec02-4355-9b2c-17e31457acda None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:11.071046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a104ad-ec02-4355-9b2c-17e31457acda None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:11.071046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a104ad-ec02-4355-9b2c-17e31457acda None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:11.072802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 682/1356] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:11.077963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158de0f-52cd-4769-b6dd-e0c83200028e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:11.078404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158de0f-52cd-4769-b6dd-e0c83200028e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:11.078572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158de0f-52cd-4769-b6dd-e0c83200028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:11.165904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d158de0f-52cd-4769-b6dd-e0c83200028e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:11.167129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d158de0f-52cd-4769-b6dd-e0c83200028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:11.269188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 675/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:11.324603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:11.325186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:11.325622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:11.327168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 683/1358] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jul 13 08:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:11.336439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7109c9-4330-474a-9778-bf7d41086065 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:11.336740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7109c9-4330-474a-9778-bf7d41086065 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:11.337173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7109c9-4330-474a-9778-bf7d41086065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:11.363826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:11.427115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9b7109c9-4330-474a-9778-bf7d41086065 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:11.428241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9b7109c9-4330-474a-9778-bf7d41086065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:11.550769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 676/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jul 13 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:11.558798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:11.560600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:11.710289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3503b3-49b6-47ae-a73b-289ab08e61a9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:11.787347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:11.830042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:11.830848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:11.831715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:11.832072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:11.833818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:11.926941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:11.928538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ac850-266d-4f74-b2f4-6a5c54e9bf20 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:11.946714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 684/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:14.196496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:14.197023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:14.197023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:14.198506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 677/1361] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:14.203517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac7b3-346c-4ca6-813b-b330c1379ae5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:14.203955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac7b3-346c-4ca6-813b-b330c1379ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:14.204133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac7b3-346c-4ca6-813b-b330c1379ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:14.272623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-248ac7b3-346c-4ca6-813b-b330c1379ae5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:14.273850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-248ac7b3-346c-4ca6-813b-b330c1379ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:14.312789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:14.381871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 685/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:14.427311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:14.428937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:14.520005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:14.612067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176186b-c3a2-4e6f-a1c4-943da37b6568 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:14.738286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef027-783c-4456-b345-516f5014418c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:14.739012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef027-783c-4456-b345-516f5014418c service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:14.739327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef027-783c-4456-b345-516f5014418c service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:14.739597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef027-783c-4456-b345-516f5014418c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:14.741352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b33ef027-783c-4456-b345-516f5014418c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:14.767224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:14.839822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef027-783c-4456-b345-516f5014418c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:14.841558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef027-783c-4456-b345-516f5014418c service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:14.861120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 678/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:17.241686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1fa2-c61e-461e-980c-d44ad0477681 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:17.242358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1fa2-c61e-461e-980c-d44ad0477681 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:17.242358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a1fa2-c61e-461e-980c-d44ad0477681 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:17.243841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 686/1364] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:17.249018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7d9a-6ced-44db-a10d-3bd9d90d394c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:17.249957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7d9a-6ced-44db-a10d-3bd9d90d394c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:17.250588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7d9a-6ced-44db-a10d-3bd9d90d394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:17.333540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-613e7d9a-6ced-44db-a10d-3bd9d90d394c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:17.335175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-613e7d9a-6ced-44db-a10d-3bd9d90d394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:17.441593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:17.451691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 679/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:17.490324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:17.490612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:17.490890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:17.492279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 687/1366] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jul 13 08:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:17.497601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473908-aa23-476d-8cda-cf81a1e28f85 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:17.497896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473908-aa23-476d-8cda-cf81a1e28f85 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:17.498196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473908-aa23-476d-8cda-cf81a1e28f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:17.575637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9c473908-aa23-476d-8cda-cf81a1e28f85 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:17.576849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9c473908-aa23-476d-8cda-cf81a1e28f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:17.696138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 680/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jul 13 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:17.704143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:17.709071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:17.877373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb00d0-6b16-4553-86e5-f2fb02038931 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:17.898794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:18.000905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:18.001473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:18.001755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:18.002028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:18.004390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:18.097572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:18.099202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137288e0-a408-4889-89e3-a2e1bbfc0932 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:18.121353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 688/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:19.113900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbe35-92af-4b01-aaee-e45e41b925bf None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:19.114490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbe35-92af-4b01-aaee-e45e41b925bf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:19.114778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbe35-92af-4b01-aaee-e45e41b925bf None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:19.116296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 681/1369] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:19.123746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfe8e-1da2-45fc-b794-12e513169d0e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:19.124201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfe8e-1da2-45fc-b794-12e513169d0e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:19.124418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfe8e-1da2-45fc-b794-12e513169d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:19.155756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:19.192903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ba7cfe8e-1da2-45fc-b794-12e513169d0e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:19.194159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ba7cfe8e-1da2-45fc-b794-12e513169d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:19.296773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 689/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:19.646818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:19.647104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:19.647441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:19.649040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 682/1371] 10.222.0.49 () {54 vars in 963 bytes} [Wed Jul 13 08:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:19.654091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274987d2-df38-4fcc-ae03-64a07806912a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:19.654770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274987d2-df38-4fcc-ae03-64a07806912a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:19.655128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274987d2-df38-4fcc-ae03-64a07806912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:19.734758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-274987d2-df38-4fcc-ae03-64a07806912a None None] MFA Rules not processed for user `f0a69afb9bc648a1badcc9a58d5f0e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:19.736087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-274987d2-df38-4fcc-ae03-64a07806912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:19.784227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:19.816133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 690/1372] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Jul 13 08:49:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:19.823457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:19.824962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:19.877409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:19.938841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61a91-2f49-4533-8eda-db762cc60aa6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:20.013895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:20.014572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:20.014851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:20.015129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:20.016756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:20.121440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:20.139588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:20.141114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6900a-521c-4ce5-93cf-c1a69702bb25 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:20.163835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 683/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:20.271110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:20.271495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:20.271655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:20.272980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 691/1374] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:49:20.278666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51a9d-1e30-45ab-873b-0979693b5601 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:20.278892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51a9d-1e30-45ab-873b-0979693b5601 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:20.279175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51a9d-1e30-45ab-873b-0979693b5601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:20.347503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-afb51a9d-1e30-45ab-873b-0979693b5601 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:20.348527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-afb51a9d-1e30-45ab-873b-0979693b5601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:20.450667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 684/1375] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:20.495279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:20.497223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:20.654498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa0095-a604-4f0d-b3da-242950e7ee05 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:20.707903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:20.770856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:20.771513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:20.771800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:20.772075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:20.773729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:20.865276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:20.866953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce61138-a84f-45c5-957f-e8a9198640a2 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:20.885427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 692/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:22.947010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:22.947524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:22.947621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:22.949006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 685/1377] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:22.954521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0f37-620b-4aac-80ca-e355e7b5bd2e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:22.954922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0f37-620b-4aac-80ca-e355e7b5bd2e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:22.955085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0f37-620b-4aac-80ca-e355e7b5bd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:23.021888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bcbf0f37-620b-4aac-80ca-e355e7b5bd2e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:23.023143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bcbf0f37-620b-4aac-80ca-e355e7b5bd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:23.029701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:23.146245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 693/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:23.189607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:23.191806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:23.252083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:23.340453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e763a76-f78d-48f4-9a7c-844fa14da50d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:23.453773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:23.454498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:23.455129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:23.455129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:23.456703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:23.480612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:23.569313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:23.570948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3233af0-d0bb-445a-a578-ac0226176920 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:23.591862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 686/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:25.681198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:25.681769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:25.682054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:25.683902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 694/1380] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:25.689704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53c8-1302-4aef-9189-97bf24d73a89 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:25.690246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53c8-1302-4aef-9189-97bf24d73a89 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:25.690455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d53c8-1302-4aef-9189-97bf24d73a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:25.760068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f41d53c8-1302-4aef-9189-97bf24d73a89 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:25.761351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f41d53c8-1302-4aef-9189-97bf24d73a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:25.854407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:25.861637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 687/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:25.905112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:25.906744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:26.072813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:26.085166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4d93e-bfae-47a0-ad5f-8cbb57551162 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:26.211925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:26.212578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:26.212862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:26.213138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:26.214809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:26.311134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:26.312647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63051b9e-5a01-40bb-b9dd-15ece93c5ea2 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:26.324120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:26.334470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 695/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:49:28.418836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:28.419341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:28.419341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:28.420674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 688/1383] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:28.426644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412afd-ed89-4ff7-ad73-f45f20705a2b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:28.427069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412afd-ed89-4ff7-ad73-f45f20705a2b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:28.427209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412afd-ed89-4ff7-ad73-f45f20705a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:28.491987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4a412afd-ed89-4ff7-ad73-f45f20705a2b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:28.493211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4a412afd-ed89-4ff7-ad73-f45f20705a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:28.593407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 696/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:28.636717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:28.638333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:28.790446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4abd6d-7be8-48bc-9628-17908c23e9b9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:28.859370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:28.906144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:28.906808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:28.907094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:28.907374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:28.909057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:28.998520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:29.000113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7c363-869a-4896-94b8-a504b16bd361 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:29.018404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 689/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:31.030321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:31.031022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:31.031022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:31.032402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 697/1386] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:31.039499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf994c0-561f-4896-b023-23a6606781b9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:31.039931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf994c0-561f-4896-b023-23a6606781b9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:31.040110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf994c0-561f-4896-b023-23a6606781b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:31.109855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fcf994c0-561f-4896-b023-23a6606781b9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:31.111211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fcf994c0-561f-4896-b023-23a6606781b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:31.144848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:31.220510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 690/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:31.269195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:31.271385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:31.352397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:31.427808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d554-51ab-4274-a4b8-be092fde7744 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:31.560249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:31.561342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:31.561703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:31.562180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:31.564343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:31.604897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:31.663593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:31.665196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b019-e66e-40e0-a18b-3aae141ace39 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:31.684934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 698/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:33.875106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:33.875636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:33.875758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:33.877580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 691/1389] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:33.883009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310430-82fe-47f2-b5ac-7a0c3cd83c1d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:33.883435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310430-82fe-47f2-b5ac-7a0c3cd83c1d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:33.883577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310430-82fe-47f2-b5ac-7a0c3cd83c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:33.948335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1b310430-82fe-47f2-b5ac-7a0c3cd83c1d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:33.949558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1b310430-82fe-47f2-b5ac-7a0c3cd83c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:34.044257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 699/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:34.088299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:34.089834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:34.236983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a63be-fa18-4e18-a166-85b14f4606ff None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:34.255130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:34.352404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:34.353061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:34.353347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:34.353626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:34.355314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:34.443280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:34.444875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd9f14-f3e0-4440-b3ba-bf9c96aea2df service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:34.462785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 692/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:35.210179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c9eb-4e9c-4007-98b7-39a01625a6f2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:35.210725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c9eb-4e9c-4007-98b7-39a01625a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:35.210725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c9eb-4e9c-4007-98b7-39a01625a6f2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:35.212108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 700/1392] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:35.217442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b0d8-5f37-4fad-b455-9419f57c541f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:35.217879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b0d8-5f37-4fad-b455-9419f57c541f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:35.218133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b0d8-5f37-4fad-b455-9419f57c541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:35.242389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:35.282896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ef32b0d8-5f37-4fad-b455-9419f57c541f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:35.284702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef32b0d8-5f37-4fad-b455-9419f57c541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:35.384987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 693/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:35.440228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:35.440545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:35.440827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:35.442249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 701/1394] 10.222.0.49 () {54 vars in 962 bytes} [Wed Jul 13 08:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:35.447442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d31c6b-2464-41b4-b40f-b268e1ae35ad None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:35.447803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d31c6b-2464-41b4-b40f-b268e1ae35ad None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:35.448169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d31c6b-2464-41b4-b40f-b268e1ae35ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:35.521835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-06d31c6b-2464-41b4-b40f-b268e1ae35ad None None] MFA Rules not processed for user `a7608808e60846798f9063d98cf7a7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:35.523087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-06d31c6b-2464-41b4-b40f-b268e1ae35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:35.563585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:35.601761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 694/1395] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Jul 13 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:35.609248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:35.610808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:35.624453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:35.716125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37eb18-8953-400a-a91a-3dd302390ca9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:35.788098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:35.788744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:35.789028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:35.789306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:35.790970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:35.857437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:35.898477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:35.899910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c9f91-a3a6-490f-aff4-5a2607e6914a service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:35.918347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 702/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:36.505310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0bef6-a9c9-4530-b44c-97c535913d0b None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.505912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0bef6-a9c9-4530-b44c-97c535913d0b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.505912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0bef6-a9c9-4530-b44c-97c535913d0b None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.507334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 695/1397] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:36.513226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.513796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.513796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.584372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:36.587376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:36.640263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810279a-2ebf-4a77-af5b-588b752409ae None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.640559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810279a-2ebf-4a77-af5b-588b752409ae None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.640840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810279a-2ebf-4a77-af5b-588b752409ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.693327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 703/1398] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:36.707686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d810279a-2ebf-4a77-af5b-588b752409ae None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:36.708888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d810279a-2ebf-4a77-af5b-588b752409ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:36.737770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:36.738822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:36.765232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:36.795157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 696/1399] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:36.838089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4856-5e6c-4863-89da-a80f1c1f15db None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.838409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4856-5e6c-4863-89da-a80f1c1f15db None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.838688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4856-5e6c-4863-89da-a80f1c1f15db None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.840053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 697/1400] 10.222.0.49 () {54 vars in 942 bytes} [Wed Jul 13 08:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:49:36.846411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.846728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.847011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.856164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ed2dc-af43-4168-acf4-f1c5fef61726 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:36.916857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:36.926706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] MFA Rules not processed for user `e317b8e3c61b456281c6f99da6c7a77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:36.927966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:36.972105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:36.972748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:36.973026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:36.973297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:36.974959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:36.996932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:37.033875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 698/1401] 10.222.0.49 () {58 vars in 1039 bytes} [Wed Jul 13 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:37.043885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:37.054280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1454-ceb8-406b-9b63-2b487edd65bb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:37.081284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:37.082070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bed47-09d4-40a2-8154-478adb6ecba6 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:37.102583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 704/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:49:37.171652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:37.172337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:37.172624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:37.172900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:37.174796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:37.177925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:37.276515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:37.278215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2278-247a-48fb-a68d-9f741dbe18d7 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:37.288253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 699/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 08:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 08:49:39.204622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:39.205763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:39.205763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:39.207154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 705/1404] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:39.212581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc927-b3d6-496b-a0a5-6480fae2e6de None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:39.213082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc927-b3d6-496b-a0a5-6480fae2e6de None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:39.213188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc927-b3d6-496b-a0a5-6480fae2e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:39.284882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e38cc927-b3d6-496b-a0a5-6480fae2e6de None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:39.286763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e38cc927-b3d6-496b-a0a5-6480fae2e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:39.385834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:39.393097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 700/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:49:39.442686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:39.444204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:39.601456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:39.604330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e6cb2-4896-41bf-a4cf-23dee257cc21 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:39.728112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:39.728679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:39.728961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:39.729237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:39.730908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:39.827403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:39.829287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401bbd7-f58a-4583-84c4-59fc2a19e828 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:39.848917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 706/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:41.924969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:41.925534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:41.925534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:41.927182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 701/1407] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:41.934662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156779c-78e8-42f7-98aa-a89ea8bc718c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:41.935175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156779c-78e8-42f7-98aa-a89ea8bc718c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:41.935303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156779c-78e8-42f7-98aa-a89ea8bc718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:41.938695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:42.010799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f156779c-78e8-42f7-98aa-a89ea8bc718c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:42.012160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f156779c-78e8-42f7-98aa-a89ea8bc718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:42.119957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 707/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:42.164616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:42.166186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:42.348459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa6d9c-b8fc-45ec-94f5-dd4ad0d85f00 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:42.422284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:42.476991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:42.477827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:42.478244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:42.478660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:42.480550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:42.581438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:42.583185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972d33-ca3e-4865-8489-185d9b364803 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:42.602887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 702/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:49:52.117830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=64 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:52.600340 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=64 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:59.391823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7078e-3cb5-41b2-9104-163a26c0d2f4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:59.392954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7078e-3cb5-41b2-9104-163a26c0d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:59.392954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7078e-3cb5-41b2-9104-163a26c0d2f4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:59.394393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 708/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed Jul 13 08:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:59.399507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc394-478a-4d9f-b025-cbc90f2ee50d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:59.399945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc394-478a-4d9f-b025-cbc90f2ee50d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:59.400094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fc394-478a-4d9f-b025-cbc90f2ee50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:59.476473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1b0fc394-478a-4d9f-b025-cbc90f2ee50d None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:59.477692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1b0fc394-478a-4d9f-b025-cbc90f2ee50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:59.582332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 703/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jul 13 08:49:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:49:59.596946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5484ac-09a1-4db3-a7a1-01e8ff7a10ef None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:59.597254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5484ac-09a1-4db3-a7a1-01e8ff7a10ef None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:59.597530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5484ac-09a1-4db3-a7a1-01e8ff7a10ef None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:59.598975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 709/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed Jul 13 08:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:49:59.603586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1ca7-dedf-457f-9132-2f38d2b9c925 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:59.603955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1ca7-dedf-457f-9132-2f38d2b9c925 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:59.604431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1ca7-dedf-457f-9132-2f38d2b9c925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:59.674304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:49:59.676904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-418a1ca7-dedf-457f-9132-2f38d2b9c925 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:49:59.678729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-418a1ca7-dedf-457f-9132-2f38d2b9c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:59.791057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 704/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Jul 13 08:49:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:02.270986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:02.271533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:02.271631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:02.272940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:02.278233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8383-6021-475d-a783-0c155316d63a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:02.278669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8383-6021-475d-a783-0c155316d63a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:02.278822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8383-6021-475d-a783-0c155316d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:02.342226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e38a8383-6021-475d-a783-0c155316d63a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:02.343411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e38a8383-6021-475d-a783-0c155316d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:02.396762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:02.438470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:02.480820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:02.482369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:02.625302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13580-f32d-4c1d-9b93-9c5c17c9f7db None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:02.695293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:02.735493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:02.736142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:02.736424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:02.736700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:02.738376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:02.824491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:02.826063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247c281-f9f2-4c4d-8812-ee8af1f0432f service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:02.843937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 711/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:03.735108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:03.736142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:03.736263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:03.737578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:03.742529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff338-b20e-4a22-b505-94bc6885c3d4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:03.742954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff338-b20e-4a22-b505-94bc6885c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:03.743084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ff338-b20e-4a22-b505-94bc6885c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:03.818197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4c8ff338-b20e-4a22-b505-94bc6885c3d4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:03.819413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4c8ff338-b20e-4a22-b505-94bc6885c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:03.845800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:03.913968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:04.064865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:04.066411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:04.208448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca273-d86f-47a2-b53e-7dc30d2a774e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:04.246707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:04.317101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:04.317676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:04.317956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:04.318258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:04.319894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:04.405680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:04.407345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52367e9b-6a68-47a7-9f38-72e1f29cc2db service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:04.425622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 707/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:05.299258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:05.299719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:05.299828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:05.301230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:05.306091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650b6e-1b0a-49cc-8f49-3cd53d44b369 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:05.306537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650b6e-1b0a-49cc-8f49-3cd53d44b369 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:05.306674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650b6e-1b0a-49cc-8f49-3cd53d44b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:05.359199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:05.381132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4a650b6e-1b0a-49cc-8f49-3cd53d44b369 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:05.382315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4a650b6e-1b0a-49cc-8f49-3cd53d44b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:05.475263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:05.625375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:05.627534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:05.771763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d89d5-aa5a-463c-b447-a8e478f86737 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:05.783511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:05.880974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:05.881684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:05.881973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:05.882297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:05.883951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:05.970622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:05.972223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a5d78-70c3-4a0f-bdd9-f4b301a1be8d service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:05.990353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 714/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:06.850636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:06.851209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:06.851209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:06.852594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:06.857520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f047-afca-46b4-9afc-fe8df9e8748f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:06.857926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f047-afca-46b4-9afc-fe8df9e8748f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:06.858074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f047-afca-46b4-9afc-fe8df9e8748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:06.876676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:06.932024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7c53f047-afca-46b4-9afc-fe8df9e8748f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:06.933214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7c53f047-afca-46b4-9afc-fe8df9e8748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:07.026700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:07.177129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:07.178678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:07.285794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:07.322643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1454-bb98-422e-9bee-efe4595ea231 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:07.546744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:07.547392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:07.547668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:07.548537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:07.550194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:07.621543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:07.635059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:07.636728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf66c0-31c8-4dee-b3d2-fe0b023591af service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:07.654418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 710/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:08.509799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:08.510364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:08.510364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:08.511709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:50:08.516485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784839f5-3e50-4b23-a921-a93eca208c01 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:08.517530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784839f5-3e50-4b23-a921-a93eca208c01 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:08.517640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784839f5-3e50-4b23-a921-a93eca208c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:08.588879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-784839f5-3e50-4b23-a921-a93eca208c01 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:08.590073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-784839f5-3e50-4b23-a921-a93eca208c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:08.681813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:08.831130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:08.832908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:08.915865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:08.976652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbbc7a-acfd-4759-a521-9f86912b3314 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:09.086246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:09.086826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:09.087115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:09.087396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:09.089035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:09.137898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:09.180128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:09.181731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47fc18-e4a5-4575-bb79-74920bc4dc2e service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:09.199504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 717/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:10.009767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:10.010364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:10.010364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:10.011734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:10.016620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148dd5-3e95-41a8-9a88-61cc2b219d15 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:10.017500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148dd5-3e95-41a8-9a88-61cc2b219d15 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:10.017671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d148dd5-3e95-41a8-9a88-61cc2b219d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:10.089636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8d148dd5-3e95-41a8-9a88-61cc2b219d15 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:10.090851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d148dd5-3e95-41a8-9a88-61cc2b219d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:10.184009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:10.332465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:10.333989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:10.381683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:10.476079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1296c-6dee-4f6d-9adb-758a921baf50 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:10.584512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:10.585083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:10.585361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:10.585629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:10.587289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:10.593962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:10.674319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:10.675890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22d6e4-20f5-4c74-a4a0-ad6597c27ac5 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:10.693302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 713/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:11.493198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:11.493705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:11.493705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:11.495239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:11.500041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684059-8a34-409c-8660-5331f7cb215d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:11.500466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684059-8a34-409c-8660-5331f7cb215d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:11.500587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684059-8a34-409c-8660-5331f7cb215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:11.578759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-02684059-8a34-409c-8660-5331f7cb215d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:11.580558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-02684059-8a34-409c-8660-5331f7cb215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:11.645855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:11.675079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:11.823864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:11.825433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:11.842930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:11.969906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2a4c-5a69-4a56-9d1c-ab07e7ca126f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:12.053708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:12.078546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:12.079128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:12.079408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:12.079683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:12.081303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:12.167707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:12.169295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e3b3-2175-4546-8ea2-0755043fc432 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:12.187471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 720/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:12.979104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:12.979634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:12.979634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:12.981014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:12.985952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd4-7fba-4a02-9925-bb5280aa2ce1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:12.986419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd4-7fba-4a02-9925-bb5280aa2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:12.986534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd4-7fba-4a02-9925-bb5280aa2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:13.058392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-609fcfd4-7fba-4a02-9925-bb5280aa2ce1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:13.059578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-609fcfd4-7fba-4a02-9925-bb5280aa2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:13.100186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:13.155657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:13.309465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:13.311014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:13.452169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24477787-db46-43b1-99a6-bb996fba8087 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:13.503926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:13.570209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:13.570859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:13.571137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:13.571411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:13.573043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:13.658704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:13.664138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa330cd2-d864-49bb-8499-e95e77a3df62 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:13.681604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 716/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:50:14.468210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:14.468633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:14.468764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:14.470295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:14.475277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6ae5-72f8-4baa-89b8-10fc40fd14e6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:14.475729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6ae5-72f8-4baa-89b8-10fc40fd14e6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:14.475836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb6ae5-72f8-4baa-89b8-10fc40fd14e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:14.549686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b0bb6ae5-72f8-4baa-89b8-10fc40fd14e6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:14.550931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b0bb6ae5-72f8-4baa-89b8-10fc40fd14e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:14.552897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:14.644681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:14.791775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:14.793347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:14.935825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0815ce-d719-4b04-ad82-c2238aad92c8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:14.962001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:15.045041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:15.045607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:15.045888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:15.046246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:15.048458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:15.134392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:15.135994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b0e2e-6df6-4c74-b170-3682a272cb7b service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:15.153742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 723/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:17.076203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:17.076764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:17.076764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:17.078158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:17.083426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d2a2-f421-450d-83e2-5c0797b79914 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:17.083848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d2a2-f421-450d-83e2-5c0797b79914 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:17.083986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d2a2-f421-450d-83e2-5c0797b79914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:17.123853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:17.148928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1f30d2a2-f421-450d-83e2-5c0797b79914 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:17.150167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1f30d2a2-f421-450d-83e2-5c0797b79914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:17.248674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:17.288120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:17.289671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:17.390085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55381b-5e1e-4998-9bac-4b25427780e3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:17.420712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:17.460153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:17.460797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:17.461076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:17.461347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:17.463002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:17.568110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:17.569496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf43b83-add5-4eb9-a372-5e389b45cc70 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:17.587664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 719/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:19.751536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:19.752061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:19.752061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:19.753401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:19.758612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79896-bb76-4456-b74c-bd1697ebfa87 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:19.759063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79896-bb76-4456-b74c-bd1697ebfa87 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:19.759170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79896-bb76-4456-b74c-bd1697ebfa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:19.820993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d1e79896-bb76-4456-b74c-bd1697ebfa87 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:19.822217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d1e79896-bb76-4456-b74c-bd1697ebfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:19.834360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:19.918727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:19.956277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:19.957835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:20.058817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79a6e-45b1-4129-b7d6-f1d82cfa2da7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:20.070509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:20.132312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:20.132962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:20.133241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:20.133529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:20.135180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:20.241256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:20.242718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5792ea-f6ad-45fc-bf7d-bf2786b1200b service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:20.260190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 726/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:22.597167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:22.597726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:22.597726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:22.599150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:22.604561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d9d8-9994-47cc-a883-e2e25abe0a0a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:22.604953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d9d8-9994-47cc-a883-e2e25abe0a0a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:22.605123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d9d8-9994-47cc-a883-e2e25abe0a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:22.650940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:22.668228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ecf1d9d8-9994-47cc-a883-e2e25abe0a0a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:22.669428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ecf1d9d8-9994-47cc-a883-e2e25abe0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:22.761940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:22.800185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:22.801730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:22.903724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00d0b-c609-48b8-8560-d6acb3c68ea8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:22.944494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:22.976297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:22.976938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:22.977217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:22.977487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:22.979163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:23.083712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:23.085136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e175496-2240-4dde-9f76-1292cca84498 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:23.102382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 722/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:25.225916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:25.226495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:25.226612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:25.227935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:25.233317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ae99-03f1-4922-9bd0-8180456b6999 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:25.233716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ae99-03f1-4922-9bd0-8180456b6999 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:25.233876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ae99-03f1-4922-9bd0-8180456b6999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:25.298001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4250ae99-03f1-4922-9bd0-8180456b6999 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:25.299219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4250ae99-03f1-4922-9bd0-8180456b6999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:25.318772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:25.393234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:25.431625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:25.433177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:25.534257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d59cd-877b-4e3d-b6f7-aa6f2d8a4d03 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:25.553607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:25.606183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:25.606834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:25.607119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:25.607395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:25.609040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:25.716330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:25.717685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519f3c3-c962-4066-9d1d-9634514f2e0c service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:25.735275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 729/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:27.812373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:27.812907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:27.813033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:27.814377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:27.819601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93981-a738-4b37-b555-42d5888ea569 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:27.820036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93981-a738-4b37-b555-42d5888ea569 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:27.820158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93981-a738-4b37-b555-42d5888ea569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:27.880134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:27.882717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-86e93981-a738-4b37-b555-42d5888ea569 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:27.884525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-86e93981-a738-4b37-b555-42d5888ea569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:27.977123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:28.015445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:28.016986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:28.118870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a6c0-7f9c-46e2-a61e-fc28f96d5376 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:28.167276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:28.191527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:28.192179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:28.192466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:28.192739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:28.194413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:28.301138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:28.302603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3c1c7-7a74-49eb-a572-b6bd9277d15a service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:28.319781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 725/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:30.458382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:30.458934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:30.458934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:30.460231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:30.465522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbaf6-17b8-4890-9c13-a2cca28b4a36 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:30.465957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbaf6-17b8-4890-9c13-a2cca28b4a36 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:30.467981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbaf6-17b8-4890-9c13-a2cca28b4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:30.528398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5febbaf6-17b8-4890-9c13-a2cca28b4a36 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:30.529603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5febbaf6-17b8-4890-9c13-a2cca28b4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:30.557831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:30.626148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:50:30.661720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:30.663302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:30.767079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba740-020d-4899-b7b8-df556e80c0ed None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:30.794982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:30.838709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:30.839352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:30.839635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:30.839914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:30.841537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:30.949223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:30.950681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f8ff-7bab-49de-8ee2-6a96da6cdfd5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:30.968311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 732/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:33.061031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:33.061562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:33.061682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:33.063571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:33.070075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c29e2-850a-42e7-886d-d5ac554c56ad None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:33.070664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c29e2-850a-42e7-886d-d5ac554c56ad None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:33.070664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c29e2-850a-42e7-886d-d5ac554c56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:33.136269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-862c29e2-850a-42e7-886d-d5ac554c56ad None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:33.137427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-862c29e2-850a-42e7-886d-d5ac554c56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:33.146259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:33.233689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:33.272619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:33.274167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:33.377618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf9df-3525-4c08-b910-d1b7fb88b142 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:33.431668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:33.450383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:33.451038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:33.451323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:33.451600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:33.453255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:33.561081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:33.562617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bbd0-1ab8-4cc4-8a2c-72f97abfdd0d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:33.582190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 728/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:35.646794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:35.647331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:35.647444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:35.648744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:35.653936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f64-09e4-4775-82a1-80b90583f8ca None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:35.654402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f64-09e4-4775-82a1-80b90583f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:35.654500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2f64-09e4-4775-82a1-80b90583f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:35.716324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1f6e2f64-09e4-4775-82a1-80b90583f8ca None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:35.717509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1f6e2f64-09e4-4775-82a1-80b90583f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:35.755149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:35.811912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:35.848256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:35.849802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:35.954039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52552-6f13-41f0-afb6-5ec6c8cdce21 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:35.990455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:36.025790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:36.026460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:36.026745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:36.027021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:36.028653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:36.135824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:36.137285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b507-a1d7-4f29-bcd0-921827b69f20 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:36.155054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 735/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:38.179412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:38.179937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:38.179937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:38.181320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:38.186510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc30a8-4885-4f3e-a25e-3222b155bd15 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:38.186942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc30a8-4885-4f3e-a25e-3222b155bd15 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:38.187078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc30a8-4885-4f3e-a25e-3222b155bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:38.250511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-43dc30a8-4885-4f3e-a25e-3222b155bd15 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:38.251713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-43dc30a8-4885-4f3e-a25e-3222b155bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:38.269395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:38.348320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:38.384893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:38.386459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:38.486676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647cd46-26af-499b-8d52-735110fdb861 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:38.551068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:38.558074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:38.558752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:38.559034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:38.559305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:38.560948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:38.665894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:38.667278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce97682-b3d0-4080-9586-2fb0cb7a565e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:38.685034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 731/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:40.704356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:40.704916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:40.704916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:40.706308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:50:40.711768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862330f-73a4-42d4-9665-7da70dde7442 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:40.712226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862330f-73a4-42d4-9665-7da70dde7442 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:40.712350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862330f-73a4-42d4-9665-7da70dde7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:40.776001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a862330f-73a4-42d4-9665-7da70dde7442 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:50:40.777203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a862330f-73a4-42d4-9665-7da70dde7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:40.824242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:40.872353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:50:40.910102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:40.911995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:41.013606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8e84-4d92-4399-b8c1-05d0b6308467 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:41.060518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:41.086599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:41.087251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:41.087536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:41.087816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:41.089478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:41.196394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:41.197834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1801-29a9-41fc-9a74-aa78a9289963 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:41.216023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 738/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:50.870540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=22 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:50:51.213786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=66 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:00.765179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d6591-b041-4c4c-b56a-2fb1b4f97053 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:00.765701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d6591-b041-4c4c-b56a-2fb1b4f97053 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:00.765808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d6591-b041-4c4c-b56a-2fb1b4f97053 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:00.767200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 733/1471] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:00.772302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d7b4-7796-4f61-9bb8-aaa43060d0d0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:00.772745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d7b4-7796-4f61-9bb8-aaa43060d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:00.772889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d7b4-7796-4f61-9bb8-aaa43060d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:00.836195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8fe8d7b4-7796-4f61-9bb8-aaa43060d0d0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:00.837384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8fe8d7b4-7796-4f61-9bb8-aaa43060d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:00.930621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 739/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:01.012763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:01.013055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:01.013336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:01.015354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 734/1473] 10.222.0.49 () {54 vars in 962 bytes} [Wed Jul 13 08:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:51:01.020051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64eb8-caae-4d2c-b65b-cf23bb2044f5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:01.020343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64eb8-caae-4d2c-b65b-cf23bb2044f5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:01.020796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64eb8-caae-4d2c-b65b-cf23bb2044f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:01.109911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e6f64eb8-caae-4d2c-b65b-cf23bb2044f5 None None] MFA Rules not processed for user `a7608808e60846798f9063d98cf7a7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:01.111137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e6f64eb8-caae-4d2c-b65b-cf23bb2044f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:01.131551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:01.185964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 740/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Jul 13 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:01.193695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:01.195280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:01.294193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8367e1-99a0-4acf-a098-8cb4d43010bc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:01.368427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:01.369083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:01.369367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:01.369644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:01.371363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:01.423762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:01.477539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:01.478945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e05dde-2664-42f4-bc17-3aa45185e94d service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:01.497367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 735/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:03.603558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:03.604064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:03.604064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:03.605422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 741/1476] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:03.610829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9033-817e-4b98-9007-2993056537fe None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:03.611245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9033-817e-4b98-9007-2993056537fe None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:03.611390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9033-817e-4b98-9007-2993056537fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:03.675059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-789e9033-817e-4b98-9007-2993056537fe None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:03.676270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-789e9033-817e-4b98-9007-2993056537fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:03.769849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 736/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:03.793917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:03.795491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:03.917887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffb015-6ae8-40fd-aa61-2661bd3dd18b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:03.965270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:04.009423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:04.010084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:04.010398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:04.010676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:04.011407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:04.013171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:51:04.013171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:51:04.013171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:51:04.014942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3dbd-a263-4247-826d-19d427101afc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:04.033276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 742/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Jul 13 08:51:03 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:51:06.064568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:06.065114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:06.065114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:06.066526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 737/1479] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:06.071798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13735e3-7660-4a4a-8870-1681c1e65305 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:06.072233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13735e3-7660-4a4a-8870-1681c1e65305 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:06.072381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13735e3-7660-4a4a-8870-1681c1e65305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:06.136395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d13735e3-7660-4a4a-8870-1681c1e65305 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:06.137593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d13735e3-7660-4a4a-8870-1681c1e65305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:06.231415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 743/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:06.273318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:06.274974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:06.285582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:06.417958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a1bd-b106-477c-8449-33043aa34ce1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:06.493889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:06.525815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:06.526486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:06.526765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:06.527034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:06.528665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:06.613511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:06.615115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc19b62-3e62-4b73-9d4a-d16dc94d7b39 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:06.632434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 738/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:08.820155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:08.820714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:08.820714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:08.822094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 744/1482] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:08.827217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d806-9792-4b63-8957-363d5382e6bb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:08.827640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d806-9792-4b63-8957-363d5382e6bb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:08.827797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d806-9792-4b63-8957-363d5382e6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:08.890001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9be9d806-9792-4b63-8957-363d5382e6bb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:08.891227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9be9d806-9792-4b63-8957-363d5382e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:08.938535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:08.987672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 739/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:09.023338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:09.024879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:09.048668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:09.126478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff000fc-d76e-4add-aac0-68947fdbcf48 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:09.198286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:09.198938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:09.199226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:09.199503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:09.201138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:09.272418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:09.307973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:09.309392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc42fe-a776-47ca-a939-0648727bb42e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:09.326750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 745/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:11.386194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:11.386701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:11.386701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:11.388048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 740/1485] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:11.393797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0eea-7010-4bfa-b005-b7fdeeb1afcc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:11.394239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0eea-7010-4bfa-b005-b7fdeeb1afcc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:11.394385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc0eea-7010-4bfa-b005-b7fdeeb1afcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:11.457042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-08bc0eea-7010-4bfa-b005-b7fdeeb1afcc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:11.458254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-08bc0eea-7010-4bfa-b005-b7fdeeb1afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:11.553014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 746/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:11.591107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:11.592690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:11.694094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d23d0-ad63-4946-b310-18d29758bd06 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:11.763268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:11.765220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:11.766050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:11.766547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:11.767057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:11.768961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:11.876835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:11.878331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ebc4-8429-4ed3-b1df-617a7e23b082 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:11.896374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 741/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:14.070657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:14.071188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:14.071307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:14.072605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 747/1488] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:14.078286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195deb6a-bb9b-48cb-8018-af13dc24d8c7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:14.078714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195deb6a-bb9b-48cb-8018-af13dc24d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:14.078823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195deb6a-bb9b-48cb-8018-af13dc24d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:14.142509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-195deb6a-bb9b-48cb-8018-af13dc24d8c7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:14.143727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-195deb6a-bb9b-48cb-8018-af13dc24d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:14.194739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:14.239204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 742/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:51:14.280247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:14.281823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:14.318165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:14.384046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b802f1-6f98-4888-91ad-c82e015cd969 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:14.455467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:14.456117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:14.456403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:14.456683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:14.458345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:14.541443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:14.570527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:14.571992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d18b2-4528-4771-8798-4e830ebe9578 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:14.590066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 748/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:16.765012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:16.765616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:16.765616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:16.766980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 743/1491] 10.222.0.49 () {54 vars in 926 bytes} [Wed Jul 13 08:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:51:16.772480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e157-e274-4bc0-95e2-dede0d42b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:16.772904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e157-e274-4bc0-95e2-dede0d42b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:16.773081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e157-e274-4bc0-95e2-dede0d42b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:16.837048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3751e157-e274-4bc0-95e2-dede0d42b6b5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:51:16.838291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3751e157-e274-4bc0-95e2-dede0d42b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:16.933799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 749/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed Jul 13 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:51:16.972742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:16.974334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:17.073687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f8de-52b4-4225-b1aa-281bb8ba3fdc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:17.144064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:17.144704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:17.144984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:17.145257 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:17.146914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:51:17.156217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:17.254925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:17.256276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abe81-7373-4321-bebf-9f4ddc9f910d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:17.274302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 744/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:26.931920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=82 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:51:27.272026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=50 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:48.544696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:48.545268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:48.545268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:48.618706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:52:48.619928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:48.713586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 750/1494] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:52:48.722023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b758bc-253d-4816-8e29-38be2374426f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:48.722550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b758bc-253d-4816-8e29-38be2374426f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:48.722658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b758bc-253d-4816-8e29-38be2374426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:48.795299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-83b758bc-253d-4816-8e29-38be2374426f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:52:48.796440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-83b758bc-253d-4816-8e29-38be2374426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:48.889836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 745/1495] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:52:48.894423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:48.895645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:48.907307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b43a-435e-4115-8c8e-563fc2fd9e8a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:48.967949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:49.000712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.001374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.001655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.001927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.002665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:52:49.002969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.003966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.003966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:52:49.003966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:52:49.004843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.016167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 751/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:52:49.024433 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b758bc-253d-4816-8e29-38be2374426f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:49.033799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b758bc-253d-4816-8e29-38be2374426f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:49.093418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:49.127185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.127850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.128129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.128402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.129093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.130880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.130880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:52:49.130880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:52:49.132079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.185385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 746/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:52:49 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:52:49.189563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:49.191187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:49.223140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0973d-d3ab-4dcd-a834-0a88647f3792 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:49.315217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.315879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.316158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.316427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.317095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.318086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.318086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:52:49.318086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:52:49.319403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.359871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 752/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:52:49 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:52:49.363806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:49.365393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:49.425575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d1835-d1f8-424f-b3ac-bc59bff36514 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:49.505763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:49.517245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.517906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.518220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.518494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.519212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.520214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.520214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:52:49.520214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:52:49.521083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.533879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 747/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:52:49.537888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:49.539472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:49.551543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba71f0-5729-4ed6-a0c8-2aa0c9e78c4a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:49.576384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:49.647292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.647898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.648179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.648454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.649173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.650209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.650209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:52:49.650209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:52:49.651634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74191b-9738-48fa-89c0-5a0871bae6b7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.664277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 753/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:52:49.669018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:49.670616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:49.702526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc333-d817-4882-9f4d-4dd1705b56a4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:49.793475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:49.794390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.794674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.794962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] PATH_INFO: `/v3/projects/ca950856c79c4e209b7f30cc38f4aa9d/users/a60ed8ab62cb48ba9b8855203965fdfe/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.816175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca950856c79c4e209b7f30cc38f4aa9d, user_id=a60ed8ab62cb48ba9b8855203965fdfe, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:49.817190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:49.817190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:52:49.817190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:52:49.819158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5da14-62be-4f18-9379-6419a4fc343f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:49.842998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 748/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:52:49 2022] PUT /identity/v3/projects/ca950856c79c4e209b7f30cc38f4aa9d/users/a60ed8ab62cb48ba9b8855203965fdfe/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:52:49.856229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c06-0723-4b29-9601-72c7805e71bb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:49.856524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c06-0723-4b29-9601-72c7805e71bb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:49.856810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6c06-0723-4b29-9601-72c7805e71bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:49.912084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e08a6c06-0723-4b29-9601-72c7805e71bb None None] MFA Rules not processed for user `a60ed8ab62cb48ba9b8855203965fdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:52:49.913240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e08a6c06-0723-4b29-9601-72c7805e71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:50.106777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 754/1502] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:52:50.119945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.120312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.120598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:50.121974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 749/1503] 10.222.0.49 () {54 vars in 963 bytes} [Wed Jul 13 08:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:52:50.127092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662b94-e124-44e0-bd67-364a1eb36bc6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.127410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662b94-e124-44e0-bd67-364a1eb36bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.127687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662b94-e124-44e0-bd67-364a1eb36bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:50.158334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:50.202470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-af662b94-e124-44e0-bd67-364a1eb36bc6 None None] MFA Rules not processed for user `f0a69afb9bc648a1badcc9a58d5f0e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:52:50.203608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-af662b94-e124-44e0-bd67-364a1eb36bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:50.278985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 755/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Jul 13 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:52:50.287027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:50.288562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:50.339549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:50.391756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd359-3a94-4d51-a998-b29f3f4ca8a4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:50.462405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:50.463012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.463298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.463606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:50.465255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:50.560087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:50.561515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:50.565021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:50.580393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 750/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:52:50.621564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d661c8-a9b2-4d8a-a30b-73b058f9c8df None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.621997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d661c8-a9b2-4d8a-a30b-73b058f9c8df None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.622174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d661c8-a9b2-4d8a-a30b-73b058f9c8df None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:50.623430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 756/1506] 10.222.0.49 () {52 vars in 829 bytes} [Wed Jul 13 08:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:52:50.627039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:50.628248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:50.734650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d690-3014-4e61-b42a-958e7296f45e service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:50.826286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:50.827159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.827440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.827713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] PATH_INFO: `/v3/users/a60ed8ab62cb48ba9b8855203965fdfe` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:50.839575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60ed8ab62cb48ba9b8855203965fdfe)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:50.840604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:50.840604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:52:50.840604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:52:50.841806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:50.851252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:50.903532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60ed8ab62cb48ba9b8855203965fdfe'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:50.914330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60ed8ab62cb48ba9b8855203965fdfe'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:50.914762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60ed8ab62cb48ba9b8855203965fdfe'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:50.927001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60ed8ab62cb48ba9b8855203965fdfe'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:50.945027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60ed8ab62cb48ba9b8855203965fdfe'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:50.950658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 751/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:52:50 2022] DELETE /identity/v3/users/a60ed8ab62cb48ba9b8855203965fdfe => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:52:50.955068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:50.955357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:50.955637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:51.009578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:52:51.010753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:51.083688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:51.096921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 757/1508] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:52:51.107023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:51.108258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:51.205896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69619f0c-939e-428b-b47b-4ba745c833c9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:51.259180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:52:51.278941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:51.279585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:51.279864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:51.280136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:51.282010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:51.390681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:51.392115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992594ca-487a-40b8-b4ed-86be5c4cda7f service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:51.410948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 752/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:52:51.773777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:51.775148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:52:51.787153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a4ab-2c6f-4f98-9162-3b04c07df431 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:51.888471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:51.889383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:51.889732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:51.890003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] PATH_INFO: `/v3/projects/ca950856c79c4e209b7f30cc38f4aa9d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:51.900954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca950856c79c4e209b7f30cc38f4aa9d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:51.901978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:52:51.901978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:52:51.901978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:52:51.903214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:51.959131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca950856c79c4e209b7f30cc38f4aa9d', 'request_id': 'req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:51.967204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca950856c79c4e209b7f30cc38f4aa9d', 'request_id': 'req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:51.980354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca950856c79c4e209b7f30cc38f4aa9d', 'request_id': 'req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:52.002402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] The token cache is being invalidate because project ca950856c79c4e209b7f30cc38f4aa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:52:52.002694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:52.003215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b1e6ccb7-a478-4df5-815e-7cd22ba4a205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:52:52.004594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 758/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:52:51 2022] DELETE /identity/v3/projects/ca950856c79c4e209b7f30cc38f4aa9d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:53:01.408693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=62 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:53:02.000401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:54:33.606400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:33.607004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:33.607004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:33.608430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:54:33.613185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510696-f756-41a9-a05b-2041956a40a4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:33.613642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510696-f756-41a9-a05b-2041956a40a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:33.613778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510696-f756-41a9-a05b-2041956a40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:33.693139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-92510696-f756-41a9-a05b-2041956a40a4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:33.694302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-92510696-f756-41a9-a05b-2041956a40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:33.795707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:33.949158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:33.951298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:34.066888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748561-4aa5-4d80-b48e-e9627e363ed8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:34.072672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:34.073363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:34.073649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:34.073930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:34.082288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:34.083905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a92dc0-0553-46c9-9083-2107e70b9991 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:34.093757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 754/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:34.921386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051192-4627-4dc9-b730-a5d85d9f13d4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:34.921947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051192-4627-4dc9-b730-a5d85d9f13d4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:34.921947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d051192-4627-4dc9-b730-a5d85d9f13d4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:34.923375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:34.928384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6515cd-3fd5-4322-9ebd-88d8ee3e8587 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:34.928787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6515cd-3fd5-4322-9ebd-88d8ee3e8587 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:34.928948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6515cd-3fd5-4322-9ebd-88d8ee3e8587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:34.948989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1e6515cd-3fd5-4322-9ebd-88d8ee3e8587 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:34.950221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1e6515cd-3fd5-4322-9ebd-88d8ee3e8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:34.958004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:35.109269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d051192-4627-4dc9-b730-a5d85d9f13d4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:35.124014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d051192-4627-4dc9-b730-a5d85d9f13d4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:35.129335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:35.129977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:35.130302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:35.130585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:35.139327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:35.140903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf3ff-56b2-489b-903d-71f503940b69 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:35.150199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 761/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:36.009446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2eb37-f528-41f9-8724-e6e27e654047 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:36.010017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2eb37-f528-41f9-8724-e6e27e654047 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:36.010017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2eb37-f528-41f9-8724-e6e27e654047 None None] PATH_INFO: `/v3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:36.011444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 756/1517] 10.222.0.39 () {54 vars in 925 bytes} [Wed Jul 13 08:54:36 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:54:36.017410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770339b-f799-48cb-9c09-657b8e04069c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:36.017843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770339b-f799-48cb-9c09-657b8e04069c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:36.017971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770339b-f799-48cb-9c09-657b8e04069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:36.077363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6770339b-f799-48cb-9c09-657b8e04069c None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:36.078606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6770339b-f799-48cb-9c09-657b8e04069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:36.095649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:54:36.150383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 762/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jul 13 08:54:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:40.065181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a93-c3ce-4690-82a2-2e31d8fe3367 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:40.065708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a93-c3ce-4690-82a2-2e31d8fe3367 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:40.065708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a93-c3ce-4690-82a2-2e31d8fe3367 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:40.067141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 757/1519] 10.222.0.49 () {54 vars in 960 bytes} [Wed Jul 13 08:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:40.072753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489e66-6d03-41f7-8451-d4e15decc730 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:40.073168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489e66-6d03-41f7-8451-d4e15decc730 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:40.073311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489e66-6d03-41f7-8451-d4e15decc730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:40.091376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-81489e66-6d03-41f7-8451-d4e15decc730 None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:40.092549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-81489e66-6d03-41f7-8451-d4e15decc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:40.100976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 763/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Wed Jul 13 08:54:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:40.108268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807a93-c3ce-4690-82a2-2e31d8fe3367 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:40.122001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807a93-c3ce-4690-82a2-2e31d8fe3367 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:40.126905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:40.127536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:40.127815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:40.128095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:40.136977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:40.138568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5db5d-8277-49cf-908f-d83a6e2e0af1 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:40.147906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 758/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:46.380550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9597-f16a-41b1-9284-9f462a72fe3d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:46.381098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9597-f16a-41b1-9284-9f462a72fe3d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:46.381098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9597-f16a-41b1-9284-9f462a72fe3d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:46.382454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:46.387350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad368-a10e-44b9-abf1-326f5330fd9f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:46.387779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad368-a10e-44b9-abf1-326f5330fd9f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:46.387938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad368-a10e-44b9-abf1-326f5330fd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:46.406406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f3aad368-a10e-44b9-abf1-326f5330fd9f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:46.407607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f3aad368-a10e-44b9-abf1-326f5330fd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:46.416035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:46.568573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c9597-f16a-41b1-9284-9f462a72fe3d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:46.583131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c9597-f16a-41b1-9284-9f462a72fe3d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:46.589050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:46.589681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:46.589966 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:46.590280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:46.598104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:46.600045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b327-b29f-4f1b-a738-d9e3ebeba213 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:46.609210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 765/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:47.433715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea312a-a4d7-4f07-909e-a1925045d08c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:47.434175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea312a-a4d7-4f07-909e-a1925045d08c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:47.434306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea312a-a4d7-4f07-909e-a1925045d08c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:47.435693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 08:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:47.440737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c42fb-88b7-4a5f-83a2-feec2d52eed2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:47.441156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c42fb-88b7-4a5f-83a2-feec2d52eed2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:47.441293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c42fb-88b7-4a5f-83a2-feec2d52eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:47.459041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-578c42fb-88b7-4a5f-83a2-feec2d52eed2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:47.460258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-578c42fb-88b7-4a5f-83a2-feec2d52eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:47.468353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:47.618081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea312a-a4d7-4f07-909e-a1925045d08c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:47.632128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea312a-a4d7-4f07-909e-a1925045d08c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:47.637461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:47.638087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:47.638393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:47.638674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:47.646579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:47.648086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108b77-6543-4af3-adce-279d177aadf4 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:47.657981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 761/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:51.481897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:51.482488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:51.482488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:51.483862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:51.489101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907acc-f169-4e37-a5b9-6788d6346297 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:51.489524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907acc-f169-4e37-a5b9-6788d6346297 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:51.489666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907acc-f169-4e37-a5b9-6788d6346297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:51.507695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c0907acc-f169-4e37-a5b9-6788d6346297 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:51.509446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c0907acc-f169-4e37-a5b9-6788d6346297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:51.517290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:51.589602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:51.591335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:51.667736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa051-6674-4fd7-b82a-6bfe70bfbc2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:51.671283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:51.671930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:51.672219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:51.672497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:51.681926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:51.683378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dacf4-41ff-487d-a7ea-4e2e83b72eea service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:51.692738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 768/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:53.705646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04282-7147-4416-b552-6120e055d203 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:53.706211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04282-7147-4416-b552-6120e055d203 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:53.706211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d04282-7147-4416-b552-6120e055d203 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:53.707540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:53.713277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc56983-d40e-4243-9ee3-82374d1e0262 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:53.713673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc56983-d40e-4243-9ee3-82374d1e0262 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:53.713835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc56983-d40e-4243-9ee3-82374d1e0262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:53.732060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2bc56983-d40e-4243-9ee3-82374d1e0262 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:53.733246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2bc56983-d40e-4243-9ee3-82374d1e0262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:53.741006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:53.776378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d04282-7147-4416-b552-6120e055d203 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:53.787259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d04282-7147-4416-b552-6120e055d203 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:53.791578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:53.792266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:53.792549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:53.792825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:53.801559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:53.803005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9abd6-dbec-4ffb-8c96-e5d478e00a7c service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:53.812241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 764/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:57.222946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:57.224049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:57.224829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:57.226896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:54:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:57.232305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963d19-1687-480b-9905-4069c211d9e4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:57.232748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963d19-1687-480b-9905-4069c211d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:57.232855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963d19-1687-480b-9905-4069c211d9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:57.250862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-36963d19-1687-480b-9905-4069c211d9e4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:57.252062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-36963d19-1687-480b-9905-4069c211d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:57.260331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:54:57.562089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:57.563803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:57.627110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:54:57.640408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8396-15e9-4bb2-8fe3-361fbd7e2cd0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:57.643974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:57.644618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:57.644900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:57.645176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:57.654906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:57.656307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12aad-f3d4-4e8f-ba1f-ed7ad1cdaeab service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:57.666432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 771/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:59.728335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:59.728853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:59.728853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:59.730213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 08:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:54:59.735387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff38a-f855-4071-b5c6-30c5dfdaab83 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:59.735791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff38a-f855-4071-b5c6-30c5dfdaab83 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:59.735945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff38a-f855-4071-b5c6-30c5dfdaab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:59.754009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8f6ff38a-f855-4071-b5c6-30c5dfdaab83 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:54:59.755224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8f6ff38a-f855-4071-b5c6-30c5dfdaab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:59.763520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:55:00.061836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:55:00.063532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:55:00.076724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4671e1-5b72-4a25-a9c9-e240a7e2d570 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:55:00.080213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:55:00.080854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:55:00.081135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:55:00.081410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:55:00.090858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:55:00.092273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d130-de98-4676-866a-8bf3f929631b service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:55:00.101485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 767/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:55:09.749337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=11 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:55:10.097331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:34.241016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.242095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.242639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.268968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.270998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.280653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 773/1540] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.289764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.290353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.290353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.315875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.317088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.328757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 768/1541] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.333360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.345352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2576e-0021-410a-bbd7-e5ec3651aa1b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.355655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.356720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.357239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.357728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.358734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:34.359273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.361580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49139ed4-96f5-4b4f-9f22-a30cc8f2fa49 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.379298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 774/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:34.387724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.402840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e10048-572e-41b7-97c3-0c0785f50abe None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.410315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.411014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.411300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.411577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.412292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.415215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.440428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9731-add1-4854-b3f9-2d8175fe9690 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.441093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9731-add1-4854-b3f9-2d8175fe9690 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.441598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9731-add1-4854-b3f9-2d8175fe9690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.477452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e32b9731-add1-4854-b3f9-2d8175fe9690 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.479277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e32b9731-add1-4854-b3f9-2d8175fe9690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.483312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 769/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:34.483312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.580730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 775/1544] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.582582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f660e-5ca0-4497-a311-86ff8b9ff4ed None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.583102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f660e-5ca0-4497-a311-86ff8b9ff4ed None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.583704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f660e-5ca0-4497-a311-86ff8b9ff4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.609702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-af1f660e-5ca0-4497-a311-86ff8b9ff4ed None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.611326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-af1f660e-5ca0-4497-a311-86ff8b9ff4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.624892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 776/1545] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.626609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d816b1-93bf-4816-8b12-fbfd766289ee None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.627145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d816b1-93bf-4816-8b12-fbfd766289ee None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.627629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d816b1-93bf-4816-8b12-fbfd766289ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.636783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a787-aac5-47ac-805b-29ec9f35d321 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.658521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-76d816b1-93bf-4816-8b12-fbfd766289ee None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.660222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-76d816b1-93bf-4816-8b12-fbfd766289ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.673540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 777/1546] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.675340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.677242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.677939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.678274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.678405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.678607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.679161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.679272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.680269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:34.680269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:56:34.680269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:56:34.681542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.707499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.710385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.722920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 778/1547] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.724109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.726387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 770/1548] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:34.731039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.736867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8210a0-7304-44aa-9602-3aa69fd27b4f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.747730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.749076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.749370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.749651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.749840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b95b3-00db-4b5b-930f-f76580390f95 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.750416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:34.750825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.752436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.768629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.769398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.769677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.769961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.770738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.772994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177a71-b309-43c7-b972-bff7bda730ef admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.773545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 779/1549] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:34.774443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.794057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f08c0a-a41d-40ad-bbd7-3a553b094cef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.794817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 771/1550] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:34.796191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.796489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.796770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.800136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.800896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.801170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.801451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.802212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:34.802526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.804959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ea3ac-fda8-4c24-8bca-b0f73df98117 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.818922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.820186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.822060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 780/1551] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:34.823629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbd9-0953-4d45-9f97-2185a4e8a739 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.823923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbd9-0953-4d45-9f97-2185a4e8a739 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.824198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbd9-0953-4d45-9f97-2185a4e8a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.833109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 772/1552] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.833727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.844188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b45f99-7d11-4f17-b868-152f956b5e21 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.848886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.849545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2fb2fbd9-0953-4d45-9f97-2185a4e8a739 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.849670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.849836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.850751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.851560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.851664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2fb2fbd9-0953-4d45-9f97-2185a4e8a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.853715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.861312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 781/1553] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.862868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.863791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.864326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.885597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:34.886977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:34.888385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 773/1554] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:34.889114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.948592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 782/1555] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:34.949558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:34.958235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d938-d41c-4029-a0f4-5f00cedcd509 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.959128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821c5e-a1c9-4a5b-a612-5e85c987089b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:34.964941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.965126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:34.965690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.965908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.966031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.966253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.966374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.966520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:34.967124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.967359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:34.968361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:34.968361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:56:34.968361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:56:34.969109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4a62-6e0f-425e-9502-e66dcac81d3b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.969670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd7718-928a-4268-9e48-f6061f103df1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:34.980383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 774/1556] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:34.981882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fce19-7efa-4dc9-b4ea-e8437c8d826a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:34.982208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fce19-7efa-4dc9-b4ea-e8437c8d826a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:34.982497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fce19-7efa-4dc9-b4ea-e8437c8d826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.003243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 783/1557] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.003465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dd1fce19-7efa-4dc9-b4ea-e8437c8d826a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.003566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891420-4192-450b-8e17-d830d5505c9d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.003566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891420-4192-450b-8e17-d830d5505c9d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.003566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891420-4192-450b-8e17-d830d5505c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.003796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd1fce19-7efa-4dc9-b4ea-e8437c8d826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.007182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.015682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.022411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-21891420-4192-450b-8e17-d830d5505c9d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.024158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-21891420-4192-450b-8e17-d830d5505c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.066185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 775/1558] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.067630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7f0-317e-4323-a065-5f86d0758d92 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.067922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7f0-317e-4323-a065-5f86d0758d92 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.068207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7f0-317e-4323-a065-5f86d0758d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.084000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 784/1559] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.086763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2b75d7f0-317e-4323-a065-5f86d0758d92 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.086981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891420-4192-450b-8e17-d830d5505c9d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.088044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2b75d7f0-317e-4323-a065-5f86d0758d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.095856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21891420-4192-450b-8e17-d830d5505c9d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.096076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 776/1560] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.097349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4a93-884e-4520-9448-b7812dd70b6c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.097641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4a93-884e-4520-9448-b7812dd70b6c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.097917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4a93-884e-4520-9448-b7812dd70b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.106868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.107557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.107854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.108132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.108827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.110786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.117069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0d8e4a93-884e-4520-9448-b7812dd70b6c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.118312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0d8e4a93-884e-4520-9448-b7812dd70b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.126992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 777/1561] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.128491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.128776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.129053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.139271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 785/1562] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.139271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.146591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59e3b-f736-4c45-a163-05e88c1e5e94 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.147940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.149140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.151999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.152868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.153163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.153442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] PATH_INFO: `/v3/projects/64229e0e0f76439881e6f029ded9d214/users/176c63d8d42745d5b3ca3d2ae52ca23a/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.157230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 778/1563] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.158033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.168339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5dab6-017d-4179-b14e-f5e3d91409fb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.169932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64229e0e0f76439881e6f029ded9d214, user_id=176c63d8d42745d5b3ca3d2ae52ca23a, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.171124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:35.171124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:56:35.171124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:56:35.173037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.173203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.173981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.174303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.174582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.175269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.177164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.189724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 786/1564] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:35 2022] PUT /identity/v3/projects/64229e0e0f76439881e6f029ded9d214/users/176c63d8d42745d5b3ca3d2ae52ca23a/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:35.189724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.201303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 779/1565] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.202137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.212700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96219b-dbcc-4099-b7c9-f2c77f8b23ef admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.249727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c130b8-824f-4297-bafc-992aaa22df22 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.254361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.255044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.255329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.255604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.256854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:35.257165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.258791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51de4-2df6-43cf-b5ed-583d43526b8e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.269412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.270082 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.270247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 787/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:35.270403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.270739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.271528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.271688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:35.271896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.272497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.272779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.273633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:35.273633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:56:35.273633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:56:35.274544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99252055-b624-41e0-a66a-093d3a397a0f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.292053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 780/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:35.292053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.292053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.292053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.297223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.298473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.305937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.306550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 788/1568] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.310347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.310486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.315105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 781/1569] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.315880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.317027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597636f3-ff96-4b40-98b0-94d39472bbfb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.322661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.323347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.323635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.323915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.324638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.326252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e15dd-385b-4cd2-95c3-73bab570a802 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.326371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ec708-181f-45a0-800a-144be2be1073 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.330999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.331649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.331933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.332235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.332981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:35.333291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.335542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.337205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 789/1570] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:35.338555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.338847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.339125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.349549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 782/1571] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:35.350369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.357296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:35.359453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:35.361709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86b1c3-ba2f-497d-9044-d83f329e61e8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.366462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.367116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.367399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.367679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.368395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.369975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.370636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 790/1572] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:35.371404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.380521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5b3ce-a43f-48fe-a641-93b9c8a941a0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.380780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 783/1573] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:35.382102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.387026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.387798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.388091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.388369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.389060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.391107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.391683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd3e6e-6b81-4962-8d4f-d12830f16311 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.396217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.396956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.397734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.398010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.398747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.400881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.417595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 791/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.418421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.425502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 784/1575] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.426444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.433483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.440241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.484748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee17c-eca6-4380-aae8-7b03adf32a48 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.489493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.490158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.490442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.490777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.491499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:35.491830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.492925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54444f5-f916-4abe-b8e9-d771c8161ea4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.493420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.497669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.498366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.498656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.498936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.499659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:35.499976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.501702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.505187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 792/1576] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:35.505187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.514054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 785/1577] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:35.514855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.516447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab827f6-0125-4b3f-bee4-828f06c7eea5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.520949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.521603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.522552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.522838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.523557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.525192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.531042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cce624-c8ba-425a-b0ba-d8b0d0c1b653 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.535910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.536059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 793/1578] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:35.536741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.536869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.537056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.537345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.538097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.540231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.570521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 786/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.570521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.596463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae592abb-f7e3-4aa9-84ec-fca0fb65a083 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.630241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f725-545b-46c3-87be-1ef2f1c26370 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.636212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.636965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.637261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.637547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.638314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.639946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.646399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.647065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.647440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.647809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.649933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 787/1580] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:35.651145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.660990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.661243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcca843-b109-4a28-bdd1-7b55ad5f603a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.662553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.665968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.666645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.666924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.667200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.667873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.669740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.672334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 794/1581] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:35.675030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.688088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8c33-c7bd-48ba-805a-43b4f585f576 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.694750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 788/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.694750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.699630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.700512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.700826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.701102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.702364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.704481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.705103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c8f3-823f-4ab6-a6de-5ec1099c3d5e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.710118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.710798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.711085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.711366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.712056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.713962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.725948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 795/1583] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.726872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.736670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d224eb-0144-4beb-95f4-564b0b5e370a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.742518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.743296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.743653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.746866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.747040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 789/1584] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.747144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.747236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.747327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.775401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 796/1585] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.776446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.796228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.802623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:35.826906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1ab3-6b27-45d9-ab3f-bcb41f74561d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.852779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e50e6-bd16-40c9-b7eb-92e0a7644ae8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.859536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.860414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.860744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.860986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.861753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.863754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.904619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 797/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:35 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:35.905419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.914076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.915202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.915702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.915944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] PATH_INFO: `/v3/projects/58aa2c784d6e4dd1af993545f584a99e/users/d8d0bc370fee460ea78320b9e006da77/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.920043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea5b0-ec61-40d9-addd-853dd6be9dbb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:35.925884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:35.927106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:35.927392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:35.927722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] PATH_INFO: `/v3/projects/5f749b5cb68b4f18a197c4aa0273b06a/users/13ca3f4ea9f0417ebc7f303fdfc70c11/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:35.933027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58aa2c784d6e4dd1af993545f584a99e, user_id=d8d0bc370fee460ea78320b9e006da77, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.937178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.948084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f749b5cb68b4f18a197c4aa0273b06a, user_id=13ca3f4ea9f0417ebc7f303fdfc70c11, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:35.950902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:35.956048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 790/1587] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:35 2022] PUT /identity/v3/projects/58aa2c784d6e4dd1af993545f584a99e/users/d8d0bc370fee460ea78320b9e006da77/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:35.956048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:35.969483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 798/1588] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:35 2022] PUT /identity/v3/projects/5f749b5cb68b4f18a197c4aa0273b06a/users/13ca3f4ea9f0417ebc7f303fdfc70c11/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:35.970384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.047290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cfe28-8357-4c72-bf1b-0d625fe23f51 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.052403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.053661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.054070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.054387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.055259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.055748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6422c7-7960-490b-b520-6ce42d1341bf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.056939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.063036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.064445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.064857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.065221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.066503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.068564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.069987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 791/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.071323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.083149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff4c6-c588-4f18-8a87-3f351cc69aab admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.087304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 799/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.088333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.095391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.096157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.096592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.096882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.097584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.100599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.101489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855e19-d18b-4ea4-9b14-f888931c6bc5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.107507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.108227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.108522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.108849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.109585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.112013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57438d6a-4ed3-49ff-859c-c48f9e32b1d9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.124923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 792/1591] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:36.125916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.138525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dab9b9-7177-42a6-84b4-cc06ce1a4d6c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.143418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.144084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.144373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.144842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.144960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 800/1592] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/users => generated 302 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:36.146155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.146486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.147208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.148117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.150927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc53c-59da-40f5-a984-aa5535cc0da3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.164835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 793/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.167949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:36.168748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.169038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.169186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:36.169298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.177512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 801/1594] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:36.181700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.192212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3066a-8156-41d0-8bae-8005c7f731ee None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.197319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.198050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.198371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.198708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.199081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] MFA Rules not processed for user `13ca3f4ea9f0417ebc7f303fdfc70c11`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:36.199497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.200934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:36.201196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.211599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 802/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.212430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.222484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce70d9-3011-4125-82eb-77fcae2fe474 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.227717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.228378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.228698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.228984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.229840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.231330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.236714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:36.243470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 803/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.244478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.254583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee3863-12cb-4125-810d-727446696c63 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.259904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.260850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.261328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.261810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.262648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.264670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.276259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 804/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.277217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.280161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 794/1598] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:36.281472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.288740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f13-9e77-41cb-b4d5-ecddf6d2f939 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.293531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.294266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.294540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.294818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.295544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.296092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcecd01-fbf2-4bcb-97a7-03e0a0dd1f13 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.297176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.302841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.304198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.304485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.304866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.305478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.308227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.309673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 805/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.310438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.321823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:36.322049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 795/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.323380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.334227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eb3ef-6f30-4616-9573-6b2ffe1d74bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.339978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.340877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.341163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.341440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] PATH_INFO: `/v3/projects/85c50e21bba649adadfba9d276760e8b/users/9af0007a1c904e16ab3eb9d0b240f92f/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.359563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c50e21bba649adadfba9d276760e8b, user_id=9af0007a1c904e16ab3eb9d0b240f92f, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.362506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.377330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841ddd-aaf3-4e92-93d9-2ce01565a88f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.408069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 796/1601] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:36 2022] PUT /identity/v3/projects/85c50e21bba649adadfba9d276760e8b/users/9af0007a1c904e16ab3eb9d0b240f92f/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:36.408069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.435851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.436599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.437023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.437369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.495819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b023e-a876-4fbb-9820-c646f6e92860 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.501110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.502077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.502498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.502835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] PATH_INFO: `/v3/projects/2f3f377b60a442368b5c85acef147a26/users/cf0d83e0a9074cc580983ed20f6417c0/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.520703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3f377b60a442368b5c85acef147a26, user_id=cf0d83e0a9074cc580983ed20f6417c0, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.524184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.524401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.526340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.543321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 797/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:36 2022] PUT /identity/v3/projects/2f3f377b60a442368b5c85acef147a26/users/cf0d83e0a9074cc580983ed20f6417c0/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:36.546963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.559874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 806/1603] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:36.560945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.573122 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983313-6cba-4b88-823e-09e12e085500 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.624097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584ce7-a430-4635-ade1-c85422d31d2e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.629566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.630305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.630674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.631703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.631976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.633790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.648492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 798/1604] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.648492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.660254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc052-7a34-41b3-9ea5-ed1d1f5f86ee admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.667352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.668043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.668389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.668675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.669502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.669641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.670347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.670707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.671215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.671438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.672203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.675643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab32c3-e9ab-4c06-8863-9efe3a9c9399 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.687211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 799/1605] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:36.688665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.696231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:36.704301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1219-8e5b-4980-844b-82ce642f5812 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.710915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:36.712239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.713799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.714548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.715062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] PATH_INFO: `/v3/projects/424a82d3bbc74de48231554a9022950f/users/1f7f7985a11d408798823d2ca5f33170/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.721285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 807/1606] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:36.723226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.724359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.724804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.738416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424a82d3bbc74de48231554a9022950f, user_id=1f7f7985a11d408798823d2ca5f33170, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.743270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d1c27-e607-4279-9bac-0af3dfe8a837 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.746290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:36.747802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:36.764712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 800/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:36 2022] PUT /identity/v3/projects/424a82d3bbc74de48231554a9022950f/users/1f7f7985a11d408798823d2ca5f33170/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:36.766727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.767688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.768174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.791145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:36.793060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:36.828396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 808/1608] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:36.830441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.843225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914f0b8-a17a-4dc7-90f7-823e9bfb5b6f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.869718 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 801/1609] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:36.870528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.887460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eba954-f5b3-40fc-b264-a155d81d9c3d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:36.892523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.893543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.893921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.894225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] PATH_INFO: `/v3/projects/c4d40e51ce654d9fa13c4221693e7d64/users/94d7c90265104b929d2614fd49c4d8c2/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.913370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d40e51ce654d9fa13c4221693e7d64, user_id=94d7c90265104b929d2614fd49c4d8c2, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.916387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.916796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:36.917850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.918168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.918453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] PATH_INFO: `/v3/projects/70d7f932420c43bea53486477feb6217/users/4e3175f2f9394dc58f4b57a3051fea5d/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:36.939211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 802/1610] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:36 2022] PUT /identity/v3/projects/c4d40e51ce654d9fa13c4221693e7d64/users/94d7c90265104b929d2614fd49c4d8c2/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:36.940157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:36.954000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d7f932420c43bea53486477feb6217, user_id=4e3175f2f9394dc58f4b57a3051fea5d, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:36.957317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dc63a-39f7-4548-9405-cc7f7ef4479a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:36.985446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 809/1611] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:36 2022] PUT /identity/v3/projects/70d7f932420c43bea53486477feb6217/users/4e3175f2f9394dc58f4b57a3051fea5d/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:36.987015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:36.987851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:36.988194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.026721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] MFA Rules not processed for user `1f7f7985a11d408798823d2ca5f33170`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:37.027965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:37.042151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3ce6-602f-4d29-94c6-802fb5681f4b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.112061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.112664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.112953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.113750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.114491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.117957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.123137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 810/1612] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:37.124340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.125967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:37.127553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:37.145671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 803/1613] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:36 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:37.145910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:37.148283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.151418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:37.209099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b418d-1b4c-44f4-bd85-706530d6dbd1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.216340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.217138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.217574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.217955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.234810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.236649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc9f56-8008-40f8-9aa0-86893d4a096b service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.248792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716bef4-08ad-479a-a450-2b8900d0f986 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.250403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 811/1614] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:37.252597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.252969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.253328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.279964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.281531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.281974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.282432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.292432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] MFA Rules not processed for user `94d7c90265104b929d2614fd49c4d8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:37.294380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:37.295811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.297894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05848a-2a3b-408a-aaf2-5108e5a7f277 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.312512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 804/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:37.313900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.314225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.314505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.341963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:37.344239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:37.357162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 805/1616] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:37.358945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.375284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84ff1-75e4-41a4-9080-cf34d3813b9a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.382736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.384051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.384333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.384610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.385310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.387832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.395738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 812/1617] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:37.399740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.416629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e6673-5390-4c85-9e44-2ed43512a4e8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.421827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.422579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.422916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.423198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.423982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.425904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.434464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 806/1618] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:37.435469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.441427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 813/1619] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:37.442371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.461458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece8d3b-680a-44aa-ae2a-e5fa29530a82 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.521071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e085afb-cf6d-427a-b818-40e9b5cac509 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.526751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.527417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.527699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.528803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.644231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.645160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.645349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.645627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.646571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.649622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.703774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 814/1620] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/projects => generated 403 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:37.704701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.738395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:37.763449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.767058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.792843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 807/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:37.793694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.795341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5ae0-0960-46a4-9485-f2051d025e3c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.801234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.802152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.802458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.802743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.804268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.805907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f0c52-8d68-4e28-a6c0-159b32d60599 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.806434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.810822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.811825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.812175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.812663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] PATH_INFO: `/v3/projects/c900bb6d245b49acbddd517133b22840/users/355e60b9ffd94b568a016700d935bc92/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.827649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:37.831563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c900bb6d245b49acbddd517133b22840, user_id=355e60b9ffd94b568a016700d935bc92, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.835672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:37.837603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 815/1622] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:37.839127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.857780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8376c4-1f74-41a8-a55d-1377f2498d8e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.866260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 808/1623] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:37 2022] PUT /identity/v3/projects/c900bb6d245b49acbddd517133b22840/users/355e60b9ffd94b568a016700d935bc92/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:37.867494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:37.973764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46ebdf-c1e3-440b-95c0-fc5c8bd1e202 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:37.986356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:37.987549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:37.988648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:37.988947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:37.992696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:37.996372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.014166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 809/1624] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:38.014166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.036573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580769d5-36f0-4c1b-bc36-fc1db3a64b2d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.043326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.053067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.054974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.055437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.056634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.058730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.061218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.063600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.065106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.065106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.066970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.071204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.081051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 810/1625] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:38.081051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.093792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef087d-4a2f-4e76-aacd-5ce2b3bb245f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.102441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.117179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 816/1626] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:37 2022] POST /identity/v3/users => generated 308 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:38.118383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.125378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.125667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.125991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] PATH_INFO: `/v3/projects/1426882422ca4e0bb669879e704e9a7c/users/b805a7d637434459ace9aa3704c2e5d2/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.145663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962b96-3c2c-40d9-9b44-e1a422f1a14f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.152336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.153366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.153653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.153964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] PATH_INFO: `/v3/projects/c900bb6d245b49acbddd517133b22840/users/355e60b9ffd94b568a016700d935bc92/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.156508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c900bb6d245b49acbddd517133b22840, user_id=355e60b9ffd94b568a016700d935bc92, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.160424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.162035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1426882422ca4e0bb669879e704e9a7c, user_id=b805a7d637434459ace9aa3704c2e5d2, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.169683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624d697-19f7-40b6-9b41-a5c2eb2597d0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.191901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 817/1627] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:38 2022] PUT /identity/v3/projects/c900bb6d245b49acbddd517133b22840/users/355e60b9ffd94b568a016700d935bc92/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:38.193107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.198027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 811/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:38 2022] PUT /identity/v3/projects/1426882422ca4e0bb669879e704e9a7c/users/b805a7d637434459ace9aa3704c2e5d2/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:38.199787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.200351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.200897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.281478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] MFA Rules not processed for user `355e60b9ffd94b568a016700d935bc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:38.284660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:38.362990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffa76-189c-45a8-b15a-8a2514878ec0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.431506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:38.506982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.507677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.507956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.510357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.511131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.515854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.516268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 812/1629] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:38.517786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.543797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff062-5915-4a6f-a985-ad1288a26e0b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.552876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 818/1630] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:38.554497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.562735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.564225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.565004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.565792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.566576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.570063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.591788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 813/1631] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:38.592676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.619694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa1c6-4b33-419e-a5ee-89df5737836d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.628930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.629898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.630154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.630438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] PATH_INFO: `/v3/projects/552814b0eb344b5bb79534dc8f800775/users/f1215e677ed94d1a927e1fcb40c99706/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.655547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552814b0eb344b5bb79534dc8f800775, user_id=f1215e677ed94d1a927e1fcb40c99706, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.658607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.671714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e296ecd-571d-4e63-9ca5-9f970c3d10ad admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.683733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 814/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:38 2022] PUT /identity/v3/projects/552814b0eb344b5bb79534dc8f800775/users/f1215e677ed94d1a927e1fcb40c99706/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:38.683733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.689978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:38.784750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.785823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.786315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.787057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.804428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bac87b-1afa-46ce-86c9-2f8355222551 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.813922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:38.816003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.816456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.817866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] PATH_INFO: `/v3/projects/1426882422ca4e0bb669879e704e9a7c/users/b805a7d637434459ace9aa3704c2e5d2/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.820750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1426882422ca4e0bb669879e704e9a7c, user_id=b805a7d637434459ace9aa3704c2e5d2, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.824591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.860160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 815/1633] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:38 2022] PUT /identity/v3/projects/1426882422ca4e0bb669879e704e9a7c/users/b805a7d637434459ace9aa3704c2e5d2/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:38.861938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:38.941023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:38.943227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0e090-104b-42b3-977f-70bbccd86d84 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:38.965962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 819/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:38.968081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:38.969630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:38.970002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:38.984084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8e2d0-cd44-495d-84a5-9f876496ac6a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:38.999963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:39.000627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.000915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.001542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.003125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:39.011001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:39.013896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] MFA Rules not processed for user `b805a7d637434459ace9aa3704c2e5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:39.017652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:39.037291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 816/1635] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:39.042716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:39.090029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7656b-652a-4b44-b5cc-58158bcf2978 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:39.091526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:39.100274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:39.101661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.102154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.102749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] PATH_INFO: `/v3/projects/552814b0eb344b5bb79534dc8f800775/users/f1215e677ed94d1a927e1fcb40c99706/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.116313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552814b0eb344b5bb79534dc8f800775, user_id=f1215e677ed94d1a927e1fcb40c99706, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:39.127619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f698ac-13a5-4c9b-a335-a90884edcbc6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:39.161750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 817/1636] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:39 2022] PUT /identity/v3/projects/552814b0eb344b5bb79534dc8f800775/users/f1215e677ed94d1a927e1fcb40c99706/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:39.164663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.165189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.165880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.201567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] MFA Rules not processed for user `f1215e677ed94d1a927e1fcb40c99706`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:39.203459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:39.211714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 820/1637] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:39.225526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:39.310954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c4ba-5bd6-4303-a4b3-46b7bd3e3c19 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:39.413157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 818/1638] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:56:39.425743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:39.426670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.427074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.427447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.446989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:39.457651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:39.465460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4e3f-7133-4a6f-b411-30de57244977 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:39.488029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:39.511535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.512884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.513969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.555693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:39.558361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:39.562769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:39.565606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:39.575489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 819/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:56:39.590752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 821/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:39.765896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:39.882545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:39.930769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed95d2-045f-461b-b2bb-e3dd372cfa9d service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:39.936361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:39.937661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:39.937949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:39.938473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] PATH_INFO: `/v3/users/1f7f7985a11d408798823d2ca5f33170` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:39.939534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:39.940561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7f7985a11d408798823d2ca5f33170)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:39.945548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.015619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a839a-b872-4e1b-8677-30a3da2580c3 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:40.031827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:40.032993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.033595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.034006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] PATH_INFO: `/v3/users/94d7c90265104b929d2614fd49c4d8c2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.036621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d7c90265104b929d2614fd49c4d8c2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:40.038667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:40.038667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: warnings.warn(msg) Jul 13 08:56:40.038667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: Jul 13 08:56:40.040418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.084108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7f7985a11d408798823d2ca5f33170'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.107026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7f7985a11d408798823d2ca5f33170'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.108670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7f7985a11d408798823d2ca5f33170'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.131043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7f7985a11d408798823d2ca5f33170'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.162774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03dce870-b70c-41da-b2e6-3d098e540527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7f7985a11d408798823d2ca5f33170'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.188876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 820/1641] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:39 2022] DELETE /identity/v3/users/1f7f7985a11d408798823d2ca5f33170 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:40.193751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.194086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.194353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.226246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d7c90265104b929d2614fd49c4d8c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.230884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:40.233186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.242659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d7c90265104b929d2614fd49c4d8c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.243289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d7c90265104b929d2614fd49c4d8c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.269493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d7c90265104b929d2614fd49c4d8c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.319277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f0423b69-fe56-4701-92c2-bbbfd9eed4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d7c90265104b929d2614fd49c4d8c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.332620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 821/1642] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:40.333601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:40.338221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 822/1643] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:39 2022] DELETE /identity/v3/users/94d7c90265104b929d2614fd49c4d8c2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:56:40.338503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.339932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.340228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.340507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.352237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb3667-ae19-4ce8-9071-4fb9145b4616 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:40.362780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:40.374493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:40.376337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.440852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:40.442639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.442789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.442953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] PATH_INFO: `/v3/users/13ca3f4ea9f0417ebc7f303fdfc70c11` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.444746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ca3f4ea9f0417ebc7f303fdfc70c11)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:40.445859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 823/1644] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:56:40.446932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.447716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:40.449692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.519829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ca3f4ea9f0417ebc7f303fdfc70c11'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.522423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:40.531496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7a145-3020-4128-a9d5-072437ffd396 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:40.537835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:40.538501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ca3f4ea9f0417ebc7f303fdfc70c11'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.539225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ca3f4ea9f0417ebc7f303fdfc70c11'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.541276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.543014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.543417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.551876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.553841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ca3f4ea9f0417ebc7f303fdfc70c11'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.580354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:40.580613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ca3f4ea9f0417ebc7f303fdfc70c11'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:40.582637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f2aa-1848-45f4-ac23-e14d51ca8ccf service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.595970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 822/1645] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:40 2022] DELETE /identity/v3/users/13ca3f4ea9f0417ebc7f303fdfc70c11 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:40.602075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:40.605868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.613799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 824/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:40.615470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.617478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.618530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.662550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:40.664982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.745560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eea2a-b9b3-4b9d-9111-c3d93085f4d6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:40.758598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:40.759430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.759813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.760211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.763180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:40.809424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 825/1647] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:40.830515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:40.850840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:40.853136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.869412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 823/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:40.898533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:40.914871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97a8e1-9531-44c4-8eae-1580e0c723d9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:40.931030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:40.931999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:40.932484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:40.932995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:40.949530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:40.951300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:40.972817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 826/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:41.639418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:41.640963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:41.679808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31913970-b73c-4806-b5e0-655535f42b77 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:41.704357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:41.715626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:41.716777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:41.717876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] PATH_INFO: `/v3/projects/424a82d3bbc74de48231554a9022950f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:41.722817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424a82d3bbc74de48231554a9022950f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:41.726891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:56:41.726891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: warnings.warn(msg) Jul 13 08:56:41.726891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: Jul 13 08:56:41.735349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:41.876329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424a82d3bbc74de48231554a9022950f', 'request_id': 'req-8ce600b2-0ed4-4de0-82a1-0a6612afac59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:41.888142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424a82d3bbc74de48231554a9022950f', 'request_id': 'req-8ce600b2-0ed4-4de0-82a1-0a6612afac59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:41.897274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424a82d3bbc74de48231554a9022950f', 'request_id': 'req-8ce600b2-0ed4-4de0-82a1-0a6612afac59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:41.922153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] The token cache is being invalidate because project 424a82d3bbc74de48231554a9022950f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:41.922616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:41.923474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:41.936408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 824/1650] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:41 2022] DELETE /identity/v3/projects/424a82d3bbc74de48231554a9022950f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:41.937630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:41.950809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41665-46d5-4a49-9f22-719dc7bcb940 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:42.049301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:42.050930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:42.051684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:42.052822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] PATH_INFO: `/v3/users/b805a7d637434459ace9aa3704c2e5d2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:42.054530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b805a7d637434459ace9aa3704c2e5d2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:42.057231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:42.149932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b805a7d637434459ace9aa3704c2e5d2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.175071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b805a7d637434459ace9aa3704c2e5d2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.176414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b805a7d637434459ace9aa3704c2e5d2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.205882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b805a7d637434459ace9aa3704c2e5d2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.235574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:42.238272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b805a7d637434459ace9aa3704c2e5d2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.275117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 827/1651] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:41 2022] DELETE /identity/v3/users/b805a7d637434459ace9aa3704c2e5d2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:42.502367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:42.504114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:42.528097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce600b2-0ed4-4de0-82a1-0a6612afac59 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:42.668616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:42.669482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:42.669771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:42.670054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] PATH_INFO: `/v3/projects/c4d40e51ce654d9fa13c4221693e7d64` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:42.671573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d40e51ce654d9fa13c4221693e7d64)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:42.673550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:42.751527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d40e51ce654d9fa13c4221693e7d64', 'request_id': 'req-f9d0522c-7d20-4bd5-8609-796403652346'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.776077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d40e51ce654d9fa13c4221693e7d64', 'request_id': 'req-f9d0522c-7d20-4bd5-8609-796403652346'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.793016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d40e51ce654d9fa13c4221693e7d64', 'request_id': 'req-f9d0522c-7d20-4bd5-8609-796403652346'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.795682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:42.828367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] The token cache is being invalidate because project c4d40e51ce654d9fa13c4221693e7d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:42.831044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.833429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:42.839795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 825/1652] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:42 2022] DELETE /identity/v3/projects/c4d40e51ce654d9fa13c4221693e7d64 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:42.841578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:42.842897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:42.869435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbfc30-a31c-4d14-8418-d3f974ec9778 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:43.019211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:43.020379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:43.020768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:43.021165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] PATH_INFO: `/v3/users/f1215e677ed94d1a927e1fcb40c99706` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:43.024737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1215e677ed94d1a927e1fcb40c99706)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:43.027520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:43.148439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1215e677ed94d1a927e1fcb40c99706'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:43.168279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1215e677ed94d1a927e1fcb40c99706'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:43.169024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1215e677ed94d1a927e1fcb40c99706'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:43.180654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1215e677ed94d1a927e1fcb40c99706'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:43.227939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1215e677ed94d1a927e1fcb40c99706'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:43.244417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 828/1653] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:42 2022] DELETE /identity/v3/users/f1215e677ed94d1a927e1fcb40c99706 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:43.633021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:43.634564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:43.653405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0522c-7d20-4bd5-8609-796403652346 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:43.847169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:43.848467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:43.848808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:43.849188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] PATH_INFO: `/v3/projects/5f749b5cb68b4f18a197c4aa0273b06a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:43.852702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f749b5cb68b4f18a197c4aa0273b06a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:43.855515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:43.988801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f749b5cb68b4f18a197c4aa0273b06a', 'request_id': 'req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.016474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f749b5cb68b4f18a197c4aa0273b06a', 'request_id': 'req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.030394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f749b5cb68b4f18a197c4aa0273b06a', 'request_id': 'req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.050824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] The token cache is being invalidate because project 5f749b5cb68b4f18a197c4aa0273b06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:44.051411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.053792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.057186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 826/1654] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:43 2022] DELETE /identity/v3/projects/5f749b5cb68b4f18a197c4aa0273b06a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:44.060720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:44.062294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:44.092042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9bfb2-4c64-408a-a69a-fec9ecce4178 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:44.241142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:44.241863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:44.242176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:44.242467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] PATH_INFO: `/v3/users/355e60b9ffd94b568a016700d935bc92` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:44.257362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=355e60b9ffd94b568a016700d935bc92)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:44.258465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:44.290262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:44.357502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355e60b9ffd94b568a016700d935bc92'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.384280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355e60b9ffd94b568a016700d935bc92'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.384898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355e60b9ffd94b568a016700d935bc92'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.398672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355e60b9ffd94b568a016700d935bc92'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.441892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355e60b9ffd94b568a016700d935bc92'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:44.455918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 829/1655] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:44 2022] DELETE /identity/v3/users/355e60b9ffd94b568a016700d935bc92 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:44.641772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:44.643339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:44.666793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb466d-32d3-494d-b47c-4726ceaf9a4a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:44.678697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:44.680475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:44.856119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:44.859134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:44.859578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9234-66b9-41f9-9339-d894d861c34e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:44.859995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:44.860242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] PATH_INFO: `/v3/projects/1426882422ca4e0bb669879e704e9a7c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:44.864968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1426882422ca4e0bb669879e704e9a7c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:44.867654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:44.879133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:44.880038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:44.880324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:44.880604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] PATH_INFO: `/v3/projects/552814b0eb344b5bb79534dc8f800775` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:44.881938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552814b0eb344b5bb79534dc8f800775)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:44.883922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:44.960610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:45.004345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1426882422ca4e0bb669879e704e9a7c', 'request_id': 'req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.019838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552814b0eb344b5bb79534dc8f800775', 'request_id': 'req-33436b1d-86d8-4905-b1e2-660976fb4716'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.025096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1426882422ca4e0bb669879e704e9a7c', 'request_id': 'req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.038492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1426882422ca4e0bb669879e704e9a7c', 'request_id': 'req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.052842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552814b0eb344b5bb79534dc8f800775', 'request_id': 'req-33436b1d-86d8-4905-b1e2-660976fb4716'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.063907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552814b0eb344b5bb79534dc8f800775', 'request_id': 'req-33436b1d-86d8-4905-b1e2-660976fb4716'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.074791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] The token cache is being invalidate because project 1426882422ca4e0bb669879e704e9a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:45.076190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.077946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-54bf6580-ddbc-4573-9d48-e85c7f8ff87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.087108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 827/1656] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:44 2022] DELETE /identity/v3/projects/1426882422ca4e0bb669879e704e9a7c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:45.092410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07e02-70e3-49b8-9cc9-eac5d4e24b0e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.092844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07e02-70e3-49b8-9cc9-eac5d4e24b0e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.093179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde07e02-70e3-49b8-9cc9-eac5d4e24b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.097562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] The token cache is being invalidate because project 552814b0eb344b5bb79534dc8f800775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:45.097870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.098655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-33436b1d-86d8-4905-b1e2-660976fb4716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:45.110254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 830/1657] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:44 2022] DELETE /identity/v3/projects/552814b0eb344b5bb79534dc8f800775 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:56:45.112114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8115-7c63-409a-957f-6f7f080ed8aa None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.112411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8115-7c63-409a-957f-6f7f080ed8aa None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.112690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8115-7c63-409a-957f-6f7f080ed8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.140965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dde07e02-70e3-49b8-9cc9-eac5d4e24b0e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:45.142138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dde07e02-70e3-49b8-9cc9-eac5d4e24b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:45.144642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0d6e8115-7c63-409a-957f-6f7f080ed8aa None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:45.147753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d6e8115-7c63-409a-957f-6f7f080ed8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:45.204791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:45.291347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 828/1658] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:45.296860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.297161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.297438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.301464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 831/1659] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:45.309989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.310501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.310588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.365372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:45.367680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:45.369088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:45.370163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:45.396370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 829/1660] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:45.405082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 832/1661] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:56:45.406030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.413441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.433059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02934-a54e-4ac1-aa97-65e11d5c0fed None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.435211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d407d-b0d2-49a6-8a71-3f801628d947 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.444114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.444785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.445071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.445350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.451045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:45.451373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.453030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.454588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.455282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.455563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.455838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.456591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:45.456896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.458762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.486913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 833/1662] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:45.492369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.495389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 830/1663] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:45.499647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.516659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae773-517d-4674-96ee-cc8cee7ef8b6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.522436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90126ee7-5a8a-46d9-9256-f1214f2788d6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.528552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.531246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.531724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.532068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.535502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.538261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.541283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.541980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.542293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.542576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.543342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.545300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.601864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 831/1664] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:56:45.606215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.611098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 834/1665] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:45.615378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.834048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8057f-5015-439b-a611-69fca1becc59 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.837999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63f92-c043-4172-b6b7-8acb3d1f9296 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.844998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.846403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.847277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.849744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.852089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.852977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.853274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.855415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.855859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.856302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.857168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.859280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.891657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 832/1666] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:45.899630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.915480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:45.929486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a0248-3fe4-48ec-9bd4-c411ea459581 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.934690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 835/1667] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:45 2022] POST /identity/v3/users => generated 291 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:45.938473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:45.952325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.955249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.955729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.963031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.964223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.968594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d3e4-6a25-4eaf-9cf8-b177abf29fc9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:45.969600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.980659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:45.981577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:45.982027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:45.982469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:45.983368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:45.985140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:45.996668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 833/1668] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:45.997704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.012301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 836/1669] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:56:46.016231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239cf01-2c94-4d2b-865d-1435848d34d0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.020035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.023466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.024212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.024501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.024777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.025783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.029540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.038475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c159d-f9e2-4d2a-a9d8-1060f10dcb66 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.047198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 834/1670] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:46.048568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.056883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.057591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.057902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.058204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.059332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.060599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.061984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adf04a-bc8b-44e0-b830-ca2b568906fe admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.070764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.071677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.071956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.072226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] PATH_INFO: `/v3/projects/7fbb54829e374df7bb4bd413fd60fa26/users/3fab80d6887d4707a55af69d67b8ff77/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.094903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 837/1671] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:46.100319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.102988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbb54829e374df7bb4bd413fd60fa26, user_id=3fab80d6887d4707a55af69d67b8ff77, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.105751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da31e6-8383-4c5a-9ecf-c4fa36f6edd4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.127001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93aa87-d6b6-4492-8e49-bf5ff3ed97d4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.143117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 835/1672] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:46 2022] PUT /identity/v3/projects/7fbb54829e374df7bb4bd413fd60fa26/users/3fab80d6887d4707a55af69d67b8ff77/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:46.149803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.150098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.150910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.188305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] MFA Rules not processed for user `3fab80d6887d4707a55af69d67b8ff77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:46.189602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:46.265133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:46.297241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.298187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.298474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.298747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] PATH_INFO: `/v3/projects/ebaf066a34634038aabb003037de4271/users/617949779c744cc1859f9c09635fe4b6/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.316118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 836/1673] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:46.320913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.330630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebaf066a34634038aabb003037de4271, user_id=617949779c744cc1859f9c09635fe4b6, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.333349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506e8d1-25ef-4422-a709-1fcaaba1ccac admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.353552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53ad9d-761f-4c38-8e0e-30c65cbf3d7f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.365181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 838/1674] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:46 2022] PUT /identity/v3/projects/ebaf066a34634038aabb003037de4271/users/617949779c744cc1859f9c09635fe4b6/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:46.376121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.377508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.377601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.377675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.377749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.377816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.377890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.378185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.380099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.434952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] MFA Rules not processed for user `617949779c744cc1859f9c09635fe4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:46.436200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:46.442905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 837/1675] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:46.447307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.597575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 839/1676] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:46.604934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.627816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db44dcc-cdfd-4dc0-b964-d1d4d1685aa9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.644547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.645363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.645755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.646153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.647542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.649845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.712575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 838/1677] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:46.716498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.738917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfce58-e250-4491-8608-e7bf7ae14efd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.748624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415332f-72d8-48dd-9326-dabaa57bc33f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.756391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.757341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.757771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.758270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.759021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:46.759424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.761044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:46.763646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:46.764756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:46.764930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.768708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:46.770553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:46.831776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 840/1678] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:46.832948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 839/1679] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:56:46.833491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.840868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:46.843839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:46.855489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:46.877918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae6318-39aa-442e-bd53-e0ec43794fec admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:46.964353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:46.988493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cd3ae-8fc9-442c-b360-176b08d7a826 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.003514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.009973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.010293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.010676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] PATH_INFO: `/v3/projects/c900bb6d245b49acbddd517133b22840` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.017153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c900bb6d245b49acbddd517133b22840)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.021862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.086509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.087296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.087590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.087872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.088574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.091945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.123709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c900bb6d245b49acbddd517133b22840', 'request_id': 'req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:47.142684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c900bb6d245b49acbddd517133b22840', 'request_id': 'req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:47.164915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 840/1680] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:46 2022] POST /identity/v3/users => generated 297 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:56:47.166912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.168638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c900bb6d245b49acbddd517133b22840', 'request_id': 'req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:47.190277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae560d-483c-458b-ad08-021df72473da admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.193095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] The token cache is being invalidate because project c900bb6d245b49acbddd517133b22840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:47.195908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:47.196931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:47.205630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 841/1681] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:46 2022] DELETE /identity/v3/projects/c900bb6d245b49acbddd517133b22840 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:47.211464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.213707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:47.328148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.329172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.329527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.329739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] PATH_INFO: `/v3/projects/d9e56985685941a0a96284bebacf9213/users/e383245297844b6da13de7d6ba388270/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.354644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e89e67-99e7-41f5-acfe-21b7b89a7c4c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.367616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.368326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.368625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.368894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.369643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.371018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e56985685941a0a96284bebacf9213, user_id=e383245297844b6da13de7d6ba388270, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.373996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.376289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e032971-63ce-48fe-af9c-d07fee7001e4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.403198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 842/1682] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:47.404929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.405485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.405946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.411066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 841/1683] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:47 2022] PUT /identity/v3/projects/d9e56985685941a0a96284bebacf9213/users/e383245297844b6da13de7d6ba388270/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:47.412675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.443358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:47.452479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:47.532606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c74a-a519-4238-9900-d7436c2a97ac admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.539439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.542501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.543420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.544635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] PATH_INFO: `/v3/projects/1f787a7fdddd4a44be988f667b942eee/users/83f2f4a261a04808ae6c13661cc800ef/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.574214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f787a7fdddd4a44be988f667b942eee, user_id=83f2f4a261a04808ae6c13661cc800ef, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.577249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a56d2-8870-4c4b-8c05-6a9745612037 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.596009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:47.602515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 843/1684] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:47.603562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.607713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 842/1685] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:47 2022] PUT /identity/v3/projects/1f787a7fdddd4a44be988f667b942eee/users/83f2f4a261a04808ae6c13661cc800ef/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:47.611039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.611566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:47.612009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.612508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.640167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bc1fd-26ef-4eda-9900-0c06538ca4ee None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.645535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:47.647784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:47.670736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:47.731019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 843/1686] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:47.732923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.747490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4c608-ba9c-42d1-b1ec-686a96b02108 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.759259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.760963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.761622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.762554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.764259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.766081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.766664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.766768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.767075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.767345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.768085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.769686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.782472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 844/1687] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:47.784112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.791095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 844/1688] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:47.792744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.800259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35ed3-ffe4-442f-bfcc-4eaacfbe2128 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.809010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.809942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.810839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.811352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.812525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:47.813044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.815399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.816787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e2e00-c3bc-44b1-8436-1d094aa76708 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:47.831481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:47.832424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:47.832672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:47.833429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] PATH_INFO: `/v3/projects/1f787a7fdddd4a44be988f667b942eee/users/83f2f4a261a04808ae6c13661cc800ef/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:47.835710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f787a7fdddd4a44be988f667b942eee, user_id=83f2f4a261a04808ae6c13661cc800ef, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:47.838456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:47.852776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 845/1689] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:47.857042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.873623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 845/1690] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:47 2022] PUT /identity/v3/projects/1f787a7fdddd4a44be988f667b942eee/users/83f2f4a261a04808ae6c13661cc800ef/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:47.875606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:47.877223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0491a-945c-4f78-be03-afd882c8ecc3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.027541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.028867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.029452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.030034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] PATH_INFO: `/v3/projects/d9e56985685941a0a96284bebacf9213/users/e383245297844b6da13de7d6ba388270/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.032466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e56985685941a0a96284bebacf9213, user_id=e383245297844b6da13de7d6ba388270, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.036049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e5aa9-ce23-4cef-9020-a122ecd75454 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.049160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 846/1691] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:47 2022] PUT /identity/v3/projects/d9e56985685941a0a96284bebacf9213/users/e383245297844b6da13de7d6ba388270/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:48.050822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6710ce-b982-48b1-9444-def491a7888d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.051887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6710ce-b982-48b1-9444-def491a7888d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.052624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6710ce-b982-48b1-9444-def491a7888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.089740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0b39-3fae-41ca-b81a-031808dcc8b4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.127259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9f6710ce-b982-48b1-9444-def491a7888d None None] MFA Rules not processed for user `83f2f4a261a04808ae6c13661cc800ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:48.129203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9f6710ce-b982-48b1-9444-def491a7888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.270425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.271126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.271449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.275801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.276561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.279805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:48.283192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df3c7e-2a78-4d8c-bd9b-575edbeaafbd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.305161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 847/1692] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:48.306668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.306966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.307700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.347759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 846/1693] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:47 2022] POST /identity/v3/projects => generated 409 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:48.350916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.351490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.351977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.383393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] MFA Rules not processed for user `176c63d8d42745d5b3ca3d2ae52ca23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:48.384798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.408116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] MFA Rules not processed for user `e383245297844b6da13de7d6ba388270`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:48.409789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.443763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:48.513503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 848/1694] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:48.523047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:48.533073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.544232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 847/1695] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:48.549099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:48.665357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966cc18-13f8-4cbe-833c-c8cde07d221e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.672704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.673407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.673690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.673965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.674690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.676613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa109f-70e0-4a3c-83fb-2e63923f56d2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.695089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b808b-5eef-4df6-8e03-10b7a2bf39b0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.704032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.704651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.704931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.705208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.730687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 848/1696] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:48 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:48.736689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.736981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.737263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.743487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 849/1697] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jul 13 08:56:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:48.744548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:48.748591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.776709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc3021-3d12-4b3f-87b6-f40635cd7bce None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.785875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.786594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.786884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.787248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.808676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.810061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.843130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 850/1698] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:48.844121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:48.844727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.846784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42e425-9178-4bd7-95bb-3655970f06e8 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.859226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 849/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:48.861769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c1ea-df52-4225-8ec5-407391185306 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.862281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c1ea-df52-4225-8ec5-407391185306 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.863161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c1ea-df52-4225-8ec5-407391185306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.882901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eb9b4-fd1d-4b65-a2f1-f2c8c79c0462 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.902909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.903616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.903907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.904189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.904929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.907301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.922065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 851/1700] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:48.926270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:48.946709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7524a-003e-40cc-a191-330e5e2a549f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:48.963254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:48.963900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b918c1ea-df52-4225-8ec5-407391185306 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:48.964104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:48.964536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:48.964824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:48.965562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:48.967181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:48.970486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b918c1ea-df52-4225-8ec5-407391185306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:48.991833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 852/1701] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:48.997052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:49.023309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:49.031867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc9d2-9b7a-4aa1-bbf9-2dd9f6531ad2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:49.046078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:49.047114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:49.047452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:49.047795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] PATH_INFO: `/v3/projects/7e882ecf956e438680e2e5d71d63301a/users/9e0566ae52374b90b99a27e839e4a782/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:49.110417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e882ecf956e438680e2e5d71d63301a, user_id=9e0566ae52374b90b99a27e839e4a782, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:49.115170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:49.142746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 853/1702] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:48 2022] PUT /identity/v3/projects/7e882ecf956e438680e2e5d71d63301a/users/9e0566ae52374b90b99a27e839e4a782/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:49.143980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:49.242874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 850/1703] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jul 13 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:49.246648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:49.248192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:49.249117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:49.305241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:49.312071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beafc20-8a11-44d1-a8a9-7bc66e2fd677 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:49.325906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:49.326763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:49.327231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:49.327614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:49.329792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:49.351917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] MFA Rules not processed for user `9e0566ae52374b90b99a27e839e4a782`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:49.355064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:49.472869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:49.475197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:49.501278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 854/1704] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:49.502312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:49.606575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 851/1705] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:49.613182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:49.661367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec18d90-5532-485a-aa4a-5bc9240f6605 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:49.695469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:49.696292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:49.696833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:49.697053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:49.815551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2de3b-0ed0-49d1-b6a4-1ccea4c5c1af None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:49.831584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:49.832368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:49.832659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:49.832984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:49.833703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:49.835925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:49.870808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:49.872858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:49.918957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 855/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:49.920144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:49.927030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 852/1707] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:49 2022] POST /identity/v3/projects => generated 409 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:49.928472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.056391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:50.070983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:50.143711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750301-e971-4c5b-a220-46ff99ad2ee6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.154383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.155058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.155344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.155624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.156357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.158386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.159083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00895b4-8de5-41db-97f7-54882c47891b service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.226646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 853/1708] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:56:49 2022] POST /identity/v3/users => generated 311 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:50.227648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.250778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c96713-a6bf-46db-83d0-0b2d80f8b5ff admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.266518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.267470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.267904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.268330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.269388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.271302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.298677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 854/1709] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:56:50.303231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.330407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ea6b-8e39-455c-97c4-903b72eafda0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.343035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.344057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.344351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.344904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] PATH_INFO: `/v3/projects/d37d37f555584053abba85a9e9bdb042/users/533602355b0d4bf68de1e8476cdbdb88/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.367290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e383245297844b6da13de7d6ba388270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e56985685941a0a96284bebacf9213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.373190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.373392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.374431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.377858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:50.379600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.383436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.383552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d37f555584053abba85a9e9bdb042, user_id=533602355b0d4bf68de1e8476cdbdb88, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.387869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.409934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 855/1710] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:50 2022] PUT /identity/v3/projects/d37d37f555584053abba85a9e9bdb042/users/533602355b0d4bf68de1e8476cdbdb88/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:56:50.414649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.430791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 856/1711] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:56:50.434907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.453928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af272-2b81-4dac-af9c-a0cded6f7a8e tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.564874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e383245297844b6da13de7d6ba388270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e56985685941a0a96284bebacf9213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.565679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.566172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.566558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.567367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.571782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.622623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 857/1712] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:56:50 2022] POST /identity/v3/projects => generated 354 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:56:50.626409 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.634770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696372-9e97-4a61-befa-96ae55786ec9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.767571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0e212-f5b0-4751-8cbb-e63713b2d296 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.783965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e383245297844b6da13de7d6ba388270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e56985685941a0a96284bebacf9213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.784865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.785166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.785573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.786730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:56:50.787196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.793199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.813057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:50.831783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 858/1713] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:56:50.857931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.858853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.860652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.862019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.870610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.874962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.907161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 856/1714] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:56:50.911315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.925351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198d01-dd2f-45ef-9cfb-96d203a3485b tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.944111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:50.945778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.946793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.947337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.947337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] PATH_INFO: `/v3/projects/d37d37f555584053abba85a9e9bdb042/users/533602355b0d4bf68de1e8476cdbdb88/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.951718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d37f555584053abba85a9e9bdb042, user_id=533602355b0d4bf68de1e8476cdbdb88, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.957456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee2c5b-bacf-45d1-8276-bc6a0503eb83 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.961085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fda4-3ba7-4f0b-b69f-3747a3ed4b13 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:50.978925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e383245297844b6da13de7d6ba388270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9e56985685941a0a96284bebacf9213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:50.980368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:50.980813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:50.981241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] PATH_INFO: `/v3/projects/36668fe6ac6b49b2b53c7c41edd2ed41` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:50.982668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36668fe6ac6b49b2b53c7c41edd2ed41)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:50.984770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:50.990711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 859/1715] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:56:50 2022] PUT /identity/v3/projects/d37d37f555584053abba85a9e9bdb042/users/533602355b0d4bf68de1e8476cdbdb88/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:51.002145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:51.002530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:51.002805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:51.032517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:51.083089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] MFA Rules not processed for user `533602355b0d4bf68de1e8476cdbdb88`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:51.086923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:51.090814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36668fe6ac6b49b2b53c7c41edd2ed41', 'request_id': 'req-fec22804-a284-4716-8851-60ceb3043611'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:51.112020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36668fe6ac6b49b2b53c7c41edd2ed41', 'request_id': 'req-fec22804-a284-4716-8851-60ceb3043611'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:51.128289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36668fe6ac6b49b2b53c7c41edd2ed41', 'request_id': 'req-fec22804-a284-4716-8851-60ceb3043611'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:51.162987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] The token cache is being invalidate because project 36668fe6ac6b49b2b53c7c41edd2ed41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:51.164486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:51.167315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:51.169154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 857/1716] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:50 2022] DELETE /identity/v3/projects/36668fe6ac6b49b2b53c7c41edd2ed41 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:56:51.294048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 860/1717] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:51.528132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:51.529616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:51.704658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22804-a284-4716-8851-60ceb3043611 tempest-VolumeQuotaClassesTest-1018492854 tempest-VolumeQuotaClassesTest-1018492854-project-admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:51.714892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:51.715504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:51.715992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:51.716277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:51.784512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:51.786454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:51.822232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 858/1718] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:51 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:52.357305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:52.359486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:52.391613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:52.408902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbd1b1-f177-419c-b931-f78502413ccf service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:52.419556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:52.421539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:52.421634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:52.421918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:52.434998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:52.543168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52cfa-1d8a-44d3-8f4f-880333822ce5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:52.562388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:52.563306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:52.563595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:52.563881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] PATH_INFO: `/v3/users/3fab80d6887d4707a55af69d67b8ff77` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:52.566347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fab80d6887d4707a55af69d67b8ff77)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:52.569069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:52.697685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fab80d6887d4707a55af69d67b8ff77'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:52.718614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fab80d6887d4707a55af69d67b8ff77'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:52.727367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fab80d6887d4707a55af69d67b8ff77'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:52.751270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fab80d6887d4707a55af69d67b8ff77'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:52.764169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:52.767923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:52.772712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:52.793472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-452f2ef4-e12e-4bb7-b5ed-317d733520d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fab80d6887d4707a55af69d67b8ff77'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:52.809704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 861/1719] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:52 2022] DELETE /identity/v3/users/3fab80d6887d4707a55af69d67b8ff77 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:52.814478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0953f3-7851-48a6-b7dc-2cf6fd0cf75b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:52.814656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0953f3-7851-48a6-b7dc-2cf6fd0cf75b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:52.814970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0953f3-7851-48a6-b7dc-2cf6fd0cf75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:52.815147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 859/1720] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:52.857417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8e0953f3-7851-48a6-b7dc-2cf6fd0cf75b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:52.860877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8e0953f3-7851-48a6-b7dc-2cf6fd0cf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:53.095740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 862/1721] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:53.206857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:53.208394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:53.359205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:53.368583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b55e-1f16-4c74-90c0-c2805652743e service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:53.497417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:53.498515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:53.500767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:53.502876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:53.532128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:53.535349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb5b9-44b5-4d16-ac53-f9234f020f9b service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:53.565733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 860/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:53.893823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37677-3e73-430b-a443-a6ed3ce9eba1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:53.894318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37677-3e73-430b-a443-a6ed3ce9eba1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:53.894318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37677-3e73-430b-a443-a6ed3ce9eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:53.966105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dcd37677-3e73-430b-a443-a6ed3ce9eba1 None None] MFA Rules not processed for user `9af0007a1c904e16ab3eb9d0b240f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:53.970829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dcd37677-3e73-430b-a443-a6ed3ce9eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:54.211310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 863/1723] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:54.299477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa37-adb5-4945-8f28-810604b6b388 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:54.300068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa37-adb5-4945-8f28-810604b6b388 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:54.300068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa37-adb5-4945-8f28-810604b6b388 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:54.301836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 861/1724] 10.222.0.49 () {54 vars in 961 bytes} [Wed Jul 13 08:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:54.327266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c8cd-184e-4607-9c1f-b6f6d118f70e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:54.329035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c8cd-184e-4607-9c1f-b6f6d118f70e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:54.329403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c8cd-184e-4607-9c1f-b6f6d118f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:54.352057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e0c2c8cd-184e-4607-9c1f-b6f6d118f70e None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:54.353514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e0c2c8cd-184e-4607-9c1f-b6f6d118f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:54.507657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 864/1725] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Jul 13 08:56:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:54.507964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfa37-adb5-4945-8f28-810604b6b388 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:54.538605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfa37-adb5-4945-8f28-810604b6b388 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:54.557741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:54.558578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:54.558789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:54.559109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:54.583726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:54.587893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5218b65-3d4f-43b3-8abd-f71abb368081 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:54.624417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 862/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:56:56.444825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:56.445900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:56.446402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:56.507761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:56.530022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] MFA Rules not processed for user `4e3175f2f9394dc58f4b57a3051fea5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:56.534432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:56.674842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 865/1727] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:56.686815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5bba-ba84-4684-89b5-bfc0e14bef47 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:56.687698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5bba-ba84-4684-89b5-bfc0e14bef47 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:56.688209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a5bba-ba84-4684-89b5-bfc0e14bef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:56.729936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d55a5bba-ba84-4684-89b5-bfc0e14bef47 None None] MFA Rules not processed for user `4e3175f2f9394dc58f4b57a3051fea5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:56.735691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d55a5bba-ba84-4684-89b5-bfc0e14bef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:56.753902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 863/1728] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:56.765056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:56.767277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:56.793981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf965c-bf6c-41b0-9b94-e9f38c9dbd07 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:56.802058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:56.803087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:56.804268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:56.804755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:56.828957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:56.832128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631604c-41dc-49a2-86c9-bb58891f8f33 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:56.898671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 866/1729] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:57.091322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf09d1-b5d4-421c-b195-321bd984ba12 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.091635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf09d1-b5d4-421c-b195-321bd984ba12 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.092105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf09d1-b5d4-421c-b195-321bd984ba12 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.101756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 864/1730] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jul 13 08:56:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:57.113246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.113703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.114200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.175382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:57.176480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.216731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 867/1731] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:57.248349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cbee9-d37f-4864-9399-4a28a7f13da9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.248886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cbee9-d37f-4864-9399-4a28a7f13da9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.249312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cbee9-d37f-4864-9399-4a28a7f13da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.253647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:57.254817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.312506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-918cbee9-d37f-4864-9399-4a28a7f13da9 None None] MFA Rules not processed for user `cf0d83e0a9074cc580983ed20f6417c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:57.314016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-918cbee9-d37f-4864-9399-4a28a7f13da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.457045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d886600-4f52-454d-bda0-41790dde6d6f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:57.463492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 865/1732] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:57.465199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.465848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:57.466256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.466599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.467385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.467872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.468301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.496972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:57.499947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911683e-29c2-452d-8325-132502de0ea3 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:57.510154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] MFA Rules not processed for user `176c63d8d42745d5b3ca3d2ae52ca23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:57.511472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.531761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 868/1733] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:57.535467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.535864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.538683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.593788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] MFA Rules not processed for user `cf0d83e0a9074cc580983ed20f6417c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:57.595051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.609221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 869/1734] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:57.630162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:57.645151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5e361-e527-4903-ac25-9dcfcbc1ff99 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:57.660767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 866/1735] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:57.673756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:57.674549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.674789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.675071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.697694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:57.700429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.716309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:57.717948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e813e42-7861-43b5-a983-8060d51d017a service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:57.720777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a8125-ec25-44d3-bd9e-5d3326fe77c1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:57.740906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:57.746343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.746933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 870/1736] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:57.755130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.758051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] PATH_INFO: `/v3/projects/7fbb54829e374df7bb4bd413fd60fa26` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.761982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbb54829e374df7bb4bd413fd60fa26)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:57.764539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:57.805537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:57.907762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746763a-4c9e-45af-855a-b188d11f49c4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.908051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746763a-4c9e-45af-855a-b188d11f49c4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.908335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746763a-4c9e-45af-855a-b188d11f49c4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.909553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbb54829e374df7bb4bd413fd60fa26', 'request_id': 'req-1aa9e00c-5832-490e-98b1-c20f06aafa8f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:57.910349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 871/1737] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jul 13 08:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:57.929867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbb54829e374df7bb4bd413fd60fa26', 'request_id': 'req-1aa9e00c-5832-490e-98b1-c20f06aafa8f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:57.930861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:57.931178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:57.931470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:57.937404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbb54829e374df7bb4bd413fd60fa26', 'request_id': 'req-1aa9e00c-5832-490e-98b1-c20f06aafa8f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:57.962139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] The token cache is being invalidate because project 7fbb54829e374df7bb4bd413fd60fa26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:56:57.962681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:57.968474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:57.972250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:57.973515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:57.974052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 867/1738] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:57 2022] DELETE /identity/v3/projects/7fbb54829e374df7bb4bd413fd60fa26 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:56:57.978675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:57.980321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:58.086195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:58.149457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 872/1739] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:56:58.162929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e00c-5832-490e-98b1-c20f06aafa8f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:58.167235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:58.168649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:58.178569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:58.179711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:58.180145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:58.180569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] PATH_INFO: `/v3/users/e383245297844b6da13de7d6ba388270` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:58.191025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e383245297844b6da13de7d6ba388270)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:58.193229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:58.289864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e383245297844b6da13de7d6ba388270'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:58.305904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e383245297844b6da13de7d6ba388270'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:58.306728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e383245297844b6da13de7d6ba388270'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:58.308267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff67cb-8d91-4a11-90b0-b897c64f71d2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:58.319753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e383245297844b6da13de7d6ba388270'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:58.320160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:58.323671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:58.323970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:58.324258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:58.332403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:58.343493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6645600b-72e7-4aa1-b5ed-42884f86304f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e383245297844b6da13de7d6ba388270'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:56:58.357603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 868/1740] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:56:57 2022] DELETE /identity/v3/users/e383245297844b6da13de7d6ba388270 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:56:58.367564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181872-f366-4f23-b488-461fdd77e19e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:58.369998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181872-f366-4f23-b488-461fdd77e19e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:58.372957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:58.373461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181872-f366-4f23-b488-461fdd77e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:58.379042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c7250-8928-4d77-af17-2007044bd3e4 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:58.411729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 873/1741] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:56:58.464035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-34181872-f366-4f23-b488-461fdd77e19e None None] MFA Rules not processed for user `d8d0bc370fee460ea78320b9e006da77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:58.465247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-34181872-f366-4f23-b488-461fdd77e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:58.544293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:56:58.626578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0c3b-a9f6-4158-a16a-98515b96d3c5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:58.627018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0c3b-a9f6-4158-a16a-98515b96d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:58.627163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0c3b-a9f6-4158-a16a-98515b96d3c5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:58.628944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 874/1742] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jul 13 08:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:58.634971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4426-3e2f-40cc-bd24-952e3d9b639e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:58.635269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4426-3e2f-40cc-bd24-952e3d9b639e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:58.635551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f4426-3e2f-40cc-bd24-952e3d9b639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:58.712936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 869/1743] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:56:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:58.750581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f40f4426-3e2f-40cc-bd24-952e3d9b639e None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:58.751825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f40f4426-3e2f-40cc-bd24-952e3d9b639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:58.911911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 875/1744] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:56:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:59.054551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181872-f366-4f23-b488-461fdd77e19e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:59.056674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-34181872-f366-4f23-b488-461fdd77e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:59.081091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181872-f366-4f23-b488-461fdd77e19e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:59.090423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:59.104886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:59.105386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:59.105812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:59.126222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:59.136667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1fb59-6243-4dde-81da-9287d61dfc43 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:59.154732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 870/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:59.288710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:59.289260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:59.289747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:59.292065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 876/1746] 10.222.0.49 () {54 vars in 912 bytes} [Wed Jul 13 08:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:56:59.297542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:59.298155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:59.298606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:59.324087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:56:59.326161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:59.335261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 871/1747] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:56:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:56:59.350188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:59.351970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:59.377070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697521-1bb7-4da5-b693-7f3ea3d3f5e5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:59.385964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:59.386651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:59.386936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:59.387215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:59.417742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:59.421324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5929-6e36-4e86-a8d1-21dbbae08f55 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:59.435251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 877/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:56:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:59.824019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:59.826000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.013360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2bef2-3a8c-45b7-8057-20fd79c27870 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:00.039120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:00.045678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.045894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.046237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] PATH_INFO: `/v3/projects/d9e56985685941a0a96284bebacf9213` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.051751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e56985685941a0a96284bebacf9213)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:00.054069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:00.065833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ed75-5f8e-466a-9388-3f1596595d3e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.066373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ed75-5f8e-466a-9388-3f1596595d3e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.066486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ed75-5f8e-466a-9388-3f1596595d3e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.068452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 878/1749] 10.222.0.49 () {54 vars in 960 bytes} [Wed Jul 13 08:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:57:00.076307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.076604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.076891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.139075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e56985685941a0a96284bebacf9213', 'request_id': 'req-c8732777-4c1a-4be8-a07d-b8e97f91da89'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.154787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:00.155578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e56985685941a0a96284bebacf9213', 'request_id': 'req-c8732777-4c1a-4be8-a07d-b8e97f91da89'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.156707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.171723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e56985685941a0a96284bebacf9213', 'request_id': 'req-c8732777-4c1a-4be8-a07d-b8e97f91da89'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.188103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] The token cache is being invalidate because project d9e56985685941a0a96284bebacf9213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:00.189491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.190457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.193782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 872/1750] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:56:59 2022] DELETE /identity/v3/projects/d9e56985685941a0a96284bebacf9213 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:00.195141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:00.196768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.247595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:00.358628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:00.381851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732777-4c1a-4be8-a07d-b8e97f91da89 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:00.382755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 879/1751] 10.222.0.49 () {58 vars in 1057 bytes} [Wed Jul 13 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:00.385239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:00.389170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.391535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:00.392735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.393421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.393931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] PATH_INFO: `/v3/users/617949779c744cc1859f9c09635fe4b6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.396794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=617949779c744cc1859f9c09635fe4b6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:00.400345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:00.525479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617949779c744cc1859f9c09635fe4b6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.544776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617949779c744cc1859f9c09635fe4b6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.545814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617949779c744cc1859f9c09635fe4b6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.562390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617949779c744cc1859f9c09635fe4b6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.574191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d2de-f73a-458d-97a7-263ff1e6457e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:00.610212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:00.610892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.611175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.611448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.616698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.643845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-034a6c5b-b24d-4cae-bd1c-4c670520e11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617949779c744cc1859f9c09635fe4b6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:00.657052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 873/1752] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:00 2022] DELETE /identity/v3/users/617949779c744cc1859f9c09635fe4b6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:00.662983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:00.663406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:00.663815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:00.709585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:00.711437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.759298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:00.761022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:00.786367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 880/1753] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:00.798987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:00.803397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.827831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 874/1754] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:00.827831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:00.827831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:00.847253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d867-7844-48c1-be42-cc5ec4726fcf service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:00.925877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:01.019478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:01.020948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.021060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.021857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.023747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.031870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d740c4-cee2-4c40-a4b4-3d55c7ed06f8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:01.037261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:01.039185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:01.046218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:01.048512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.049629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.051186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.074669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:01.076120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 881/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:01.077149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:01.091083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.111576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041369c2-1551-4041-88b6-edde8543f27d service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:01.133771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211e9b2-80b5-43eb-b99f-db3038f53fd5 service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:01.135644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 875/1756] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:01.141349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac01-7458-4480-88f4-4b10eedcf085 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.141654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac01-7458-4480-88f4-4b10eedcf085 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.141939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010ac01-7458-4480-88f4-4b10eedcf085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.145486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:01.147485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.147780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.148058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] PATH_INFO: `/v3/users/9e0566ae52374b90b99a27e839e4a782` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.150681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0566ae52374b90b99a27e839e4a782)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:01.160973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:01.173375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9010ac01-7458-4480-88f4-4b10eedcf085 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:01.175167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9010ac01-7458-4480-88f4-4b10eedcf085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.184044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 876/1757] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:01.192396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.193605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.193605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.232458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:01.244830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:01.247676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.284452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 877/1758] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:01.284452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:01.284452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.359412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0566ae52374b90b99a27e839e4a782'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:01.384972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0566ae52374b90b99a27e839e4a782'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:01.385887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0566ae52374b90b99a27e839e4a782'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:01.412794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0566ae52374b90b99a27e839e4a782'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:01.466227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0566ae52374b90b99a27e839e4a782'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:01.484278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 882/1759] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:01 2022] DELETE /identity/v3/users/9e0566ae52374b90b99a27e839e4a782 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:01.488787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:01.496375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.567384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8711e2c-900e-46ee-b14b-0be16f5c9ba0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:01.699111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b45f-45c2-4011-b5bc-4220b6436a9a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:01.729373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:01.730843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.731017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.731393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.732146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:01.732465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:01.734179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb9b5e-4c04-4aad-a428-960e33943fa2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:01.763350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:01.769296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.769653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.769947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.779907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.818975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 883/1760] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:01.822432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54d27-1b88-405e-b954-733cf48b4766 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.822733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54d27-1b88-405e-b954-733cf48b4766 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.823023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54d27-1b88-405e-b954-733cf48b4766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.844396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:01.850937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716f55-0d11-4693-a28d-dd9ee11852f2 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:01.872094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-42f54d27-1b88-405e-b954-733cf48b4766 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:01.873682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-42f54d27-1b88-405e-b954-733cf48b4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.902015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 884/1761] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:01.903290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.903729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.904147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.909168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 878/1762] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:01.913491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:01.914494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:01.915074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:01.956815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] MFA Rules not processed for user `cf0d83e0a9074cc580983ed20f6417c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:01.960148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:01.994350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] MFA Rules not processed for user `9af0007a1c904e16ab3eb9d0b240f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:01.995765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:02.132347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 885/1763] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:02.134281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.178576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3e96c-1052-49fc-8eeb-224d0b135766 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.211003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.211973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 879/1764] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:02.217772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.219577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.220727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.221188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.222547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.224840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:02.225388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.273538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 886/1765] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:02 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:02.277837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.297343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:02.305492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51b4e-4854-48f9-aa62-2e377a785cd7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.379138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:02.483700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b31d-74dc-420d-a7ed-48767b8cd4ee admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.493540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.494284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.494548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.494831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.498188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.499514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.499995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.500470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.505206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.513905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.515089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.517401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.566098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 887/1766] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:02 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:02.568118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 880/1767] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:02.576784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.623426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251160-dfe0-4958-8c1a-1d78573cb823 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.631455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.632486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.632954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.633381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.634297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.636838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.696988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 888/1768] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:02.700841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.719675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290820-51bf-4377-9f02-6c3f6192b40a service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.732273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.734710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.736899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.738706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.739814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.745503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d77b2-0ec8-4e94-b495-60b75a59e9f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.781558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 881/1769] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:02.785720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:02.801018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6351b-ff4f-4d18-b87c-fc31af726fd7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:02.812728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:02.813899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.814513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.814996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] PATH_INFO: `/v3/projects/bed43c202d754c3fb55e4feb836b215f/users/fbd3fa2487c44de1ae37e3a5facee312/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:02.880024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed43c202d754c3fb55e4feb836b215f, user_id=fbd3fa2487c44de1ae37e3a5facee312, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:02.891444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:02.929751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 889/1770] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:02 2022] PUT /identity/v3/projects/bed43c202d754c3fb55e4feb836b215f/users/fbd3fa2487c44de1ae37e3a5facee312/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:02.939869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:02.940382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:02.940527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:03.036708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] MFA Rules not processed for user `fbd3fa2487c44de1ae37e3a5facee312`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:03.041751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:03.222744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 882/1771] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:03.224354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:03.406148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73565-f7f8-416b-a45a-2a2fecb9f6a4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:03.419555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:03.420408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:03.420704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:03.423171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:03.424037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:03.435773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:03.508035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 890/1772] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:03 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:03.509100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:03.531447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ad0a6-553b-43dd-9e96-1a247d83875e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:03.690549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:03.691267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:03.691563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:03.692054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:03.695500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:03.697778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:03.743018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 883/1773] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:03 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:03.746681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:03.769001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced6c4-9cdd-46d0-984d-29fa413aba3a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:03.785252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:03.787540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:03.788033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:03.788522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:03.793127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:03.796264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:03.847648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 891/1774] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:03.850522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:03.873529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124317-df56-430c-a8c5-f659d36751c9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:03.909398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:03.910629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:03.911771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:03.912304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] PATH_INFO: `/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8/users/c52b933217db4386a2c1d5407205afb9/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:03.985208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b634c1a1954f4b139f9ae7196b69d3f8, user_id=c52b933217db4386a2c1d5407205afb9, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:03.991269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:04.033251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 884/1775] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:03 2022] PUT /identity/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8/users/c52b933217db4386a2c1d5407205afb9/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:04.037299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:04.051643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8643-ff6f-4d39-badf-0cc448c0a644 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:04.180474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:04.285594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:04.288132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:04.288782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:04.289239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:04.291328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:04.293131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb010a-ae80-4a58-851e-ff5d33574227 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:04.330586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:04.330900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 892/1776] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:04.348006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a19b5-8cd8-4836-9e28-9e59974e47aa admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:04.371956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:04.372941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:04.375633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:04.376032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] PATH_INFO: `/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8/users/c52b933217db4386a2c1d5407205afb9/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:04.381265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b634c1a1954f4b139f9ae7196b69d3f8, user_id=c52b933217db4386a2c1d5407205afb9, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:04.388784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:04.422078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:04.437103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 885/1777] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:04 2022] PUT /identity/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8/users/c52b933217db4386a2c1d5407205afb9/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:04.448659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:04.448959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:04.449343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:04.511764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] MFA Rules not processed for user `c52b933217db4386a2c1d5407205afb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:04.511764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:04.544633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:04.546501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:04.782042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baf162-8dda-43cf-b09d-80419667f1f3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:04.787807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 893/1778] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:04.793836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:04.796049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:04.796347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:04.796632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] PATH_INFO: `/v3/projects/7e882ecf956e438680e2e5d71d63301a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:04.798497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e882ecf956e438680e2e5d71d63301a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:04.800988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:04.805434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:04.807273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:04.922443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796d43e-c77f-46e1-8217-ca02c705d1d9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:04.926295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:04.927038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:04.927380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:04.935201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:04.948465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:04.953475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cda1b-fc2b-48c8-8aed-8d9196c83441 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:04.997085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 894/1779] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:05.040982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e882ecf956e438680e2e5d71d63301a', 'request_id': 'req-2b2356cc-ec15-4f73-8543-05aa94de8cc4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.079829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e882ecf956e438680e2e5d71d63301a', 'request_id': 'req-2b2356cc-ec15-4f73-8543-05aa94de8cc4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.104956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e882ecf956e438680e2e5d71d63301a', 'request_id': 'req-2b2356cc-ec15-4f73-8543-05aa94de8cc4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.112897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:05.113199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:05.113507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:05.157969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] The token cache is being invalidate because project 7e882ecf956e438680e2e5d71d63301a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:05.158319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.159848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.162929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 886/1780] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:04 2022] DELETE /identity/v3/projects/7e882ecf956e438680e2e5d71d63301a => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:05.166711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:05.169053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:05.332334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:05.344929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2356cc-ec15-4f73-8543-05aa94de8cc4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:05.345633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:05.385168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:05.392701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:05.394027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:05.395030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] PATH_INFO: `/v3/users/533602355b0d4bf68de1e8476cdbdb88` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:05.398356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=533602355b0d4bf68de1e8476cdbdb88)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:05.403107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:05.494888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:05.511605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:05.547439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533602355b0d4bf68de1e8476cdbdb88'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.571858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533602355b0d4bf68de1e8476cdbdb88'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.573222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533602355b0d4bf68de1e8476cdbdb88'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.615538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533602355b0d4bf68de1e8476cdbdb88'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.636227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 895/1781] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:05.696961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533602355b0d4bf68de1e8476cdbdb88'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:05.704414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:05.707188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:05.731476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 887/1782] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:05 2022] DELETE /identity/v3/users/533602355b0d4bf68de1e8476cdbdb88 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:05.756491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd746045-f533-4ddd-bdbf-6c76519ae396 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:06.005871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:06.010313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:06.010742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:06.011154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] PATH_INFO: `/v3/projects/ebaf066a34634038aabb003037de4271` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:06.014888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebaf066a34634038aabb003037de4271)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:06.017462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:06.050693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:06.053375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.149758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebaf066a34634038aabb003037de4271', 'request_id': 'req-f064c7ac-8a42-4984-8583-168739dbb7e9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.170020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebaf066a34634038aabb003037de4271', 'request_id': 'req-f064c7ac-8a42-4984-8583-168739dbb7e9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.182350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebaf066a34634038aabb003037de4271', 'request_id': 'req-f064c7ac-8a42-4984-8583-168739dbb7e9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.206077 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] The token cache is being invalidate because project ebaf066a34634038aabb003037de4271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:06.206559 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.212379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.217778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 896/1783] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:05 2022] DELETE /identity/v3/projects/ebaf066a34634038aabb003037de4271 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:06.219565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:06.227863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.245866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be06c-e24f-4881-b227-6998e60922eb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:06.415475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064c7ac-8a42-4984-8583-168739dbb7e9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:06.438701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:06.439771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:06.441306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:06.441600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:06.441833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:06.442929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:06.443767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:06.444420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] PATH_INFO: `/v3/users/fbd3fa2487c44de1ae37e3a5facee312` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:06.446073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.447050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd3fa2487c44de1ae37e3a5facee312)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:06.453513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:06.467683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:06.545319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:06.607053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd3fa2487c44de1ae37e3a5facee312'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.633425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd3fa2487c44de1ae37e3a5facee312'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.634513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd3fa2487c44de1ae37e3a5facee312'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.647284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd3fa2487c44de1ae37e3a5facee312'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.650865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:06.656463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:06.676582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-dd95e8e0-c155-49c1-bac2-8fb3390a3ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd3fa2487c44de1ae37e3a5facee312'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.683160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 888/1784] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 08:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 08:57:06.684279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:06.688939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 897/1785] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:06 2022] DELETE /identity/v3/users/fbd3fa2487c44de1ae37e3a5facee312 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:06.695564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.697985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:06.700016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:06.700016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:06.731481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f557be-78dc-4b19-ba83-52f68dbcb6ac service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:06.737499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:06.747988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.834635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 898/1786] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:06.848323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:06.848323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:06.848323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:06.848323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] PATH_INFO: `/v3/users/83f2f4a261a04808ae6c13661cc800ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:06.848781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f2f4a261a04808ae6c13661cc800ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:06.849656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:06.909864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:06.911864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:06.959439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f2f4a261a04808ae6c13661cc800ef'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.987538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f2f4a261a04808ae6c13661cc800ef'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:06.988420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f2f4a261a04808ae6c13661cc800ef'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:07.005428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f2f4a261a04808ae6c13661cc800ef'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:07.064945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5896654c-8f7a-4bbe-aea4-eed599094714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f2f4a261a04808ae6c13661cc800ef'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:07.086801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 889/1787] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:06 2022] DELETE /identity/v3/users/83f2f4a261a04808ae6c13661cc800ef => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:07.173678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d899a6-f37c-4984-a813-5f0c1440830e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:07.278378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:07.307263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:07.308545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:07.309335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:07.310006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:07.313198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:07.501497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:07.502998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:07.545839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 899/1788] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:08.092625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425bc8-b208-4104-9c1c-4182571454d6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:08.093208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425bc8-b208-4104-9c1c-4182571454d6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:08.093304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425bc8-b208-4104-9c1c-4182571454d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:08.187747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b8425bc8-b208-4104-9c1c-4182571454d6 None None] MFA Rules not processed for user `d8d0bc370fee460ea78320b9e006da77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:08.191639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b8425bc8-b208-4104-9c1c-4182571454d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:08.443040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:08.490090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 890/1789] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:08.837969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:08.840318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:08.866371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2685c16-e9a5-4c52-b744-1d26874382b1 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:08.879619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:08.881276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:08.881549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:08.881826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] PATH_INFO: `/v3/projects/d37d37f555584053abba85a9e9bdb042` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:08.889984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37d37f555584053abba85a9e9bdb042)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:08.892039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:08.999325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37d37f555584053abba85a9e9bdb042', 'request_id': 'req-f5d019b7-269f-4ed0-a456-09dd860157f5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:09.010365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37d37f555584053abba85a9e9bdb042', 'request_id': 'req-f5d019b7-269f-4ed0-a456-09dd860157f5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:09.022660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37d37f555584053abba85a9e9bdb042', 'request_id': 'req-f5d019b7-269f-4ed0-a456-09dd860157f5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:09.038084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] The token cache is being invalidate because project d37d37f555584053abba85a9e9bdb042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:09.038442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:09.039170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f5d019b7-269f-4ed0-a456-09dd860157f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:09.041406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 900/1790] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:08 2022] DELETE /identity/v3/projects/d37d37f555584053abba85a9e9bdb042 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:09.046861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.047195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.047713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.100045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:09.101315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:09.188060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 891/1791] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:09.196535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.196839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.197111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.263974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:09.265239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:09.298820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 901/1792] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:09.303474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.328000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1806b-9778-4a9c-9233-85e1e3775cda None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.351006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.352803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.353847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.358212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.359347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:09.361094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:09.368679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:09.411175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 892/1793] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:09.416202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.432396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e64b8-ecf1-4be8-b2dc-904a07371560 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.447269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.448210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.448711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.449457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.450414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:09.454475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:09.522755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 902/1794] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:09 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:09.527137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.546690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002023-9669-4e0b-a43c-454eacda6b66 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.717946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.718839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.719136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.719424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.720129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:09.727194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:09.799638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 893/1795] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:09 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:09.805580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.829504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72931-721c-448e-974c-35e1dd5c9720 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.895007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.897018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.897857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.902231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.906361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:09.912646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:09.963634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 903/1796] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:09.967954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.984682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2ca07-7519-457a-89fd-709c1ec6aca3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.994142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.995771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.996421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.997186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.998745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:10.001087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b4f0e-92a8-464e-a3e5-04a600da1e81 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:10.096159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 894/1797] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:10.098309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:10.120409 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80badb0a-69f2-4b3d-b1a7-665a55facd6b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:10.136183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:10.139107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:10.139107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:10.139107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] PATH_INFO: `/v3/projects/b1f80e4cf23f42f1ab7cbb6113bfbf3f/users/1c758cb7b97a4a63aa7ddd5d2561ec37/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:10.189332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f80e4cf23f42f1ab7cbb6113bfbf3f, user_id=1c758cb7b97a4a63aa7ddd5d2561ec37, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:10.193420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:10.233273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 904/1798] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:10 2022] PUT /identity/v3/projects/b1f80e4cf23f42f1ab7cbb6113bfbf3f/users/1c758cb7b97a4a63aa7ddd5d2561ec37/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:10.235480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fd68-0d7a-4846-be53-1b83074dceb0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:10.236914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fd68-0d7a-4846-be53-1b83074dceb0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:10.237390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fd68-0d7a-4846-be53-1b83074dceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:10.300528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1a86fd68-0d7a-4846-be53-1b83074dceb0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:10.313769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1a86fd68-0d7a-4846-be53-1b83074dceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:10.465696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 895/1799] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:10.565160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:10.570974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:10.618215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:10.757921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a69ac-652f-4b55-9bd2-eb509f81721a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:10.769342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:10.771015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:10.771604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:10.772141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:10.794738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:10.796968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:10.827132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 905/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:10.852346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c10d8-7cd1-47ea-b331-f700255d872a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:10.852632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c10d8-7cd1-47ea-b331-f700255d872a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:10.853372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c10d8-7cd1-47ea-b331-f700255d872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:10.859572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:10.909813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:10.911821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:10.916302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-751c10d8-7cd1-47ea-b331-f700255d872a None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:10.922536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-751c10d8-7cd1-47ea-b331-f700255d872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:10.944477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 896/1801] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jul 13 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:10.952992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fd9b5-b8b9-408e-ba26-7d265c35be5e service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:10.969871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:10.970795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:10.971086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:10.971371 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] PATH_INFO: `/v3/projects/1f787a7fdddd4a44be988f667b942eee` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:10.973058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f787a7fdddd4a44be988f667b942eee)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:10.975979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:11.143803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f787a7fdddd4a44be988f667b942eee', 'request_id': 'req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.167174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f787a7fdddd4a44be988f667b942eee', 'request_id': 'req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.176417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f787a7fdddd4a44be988f667b942eee', 'request_id': 'req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.207626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] The token cache is being invalidate because project 1f787a7fdddd4a44be988f667b942eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:11.207974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.211523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.213388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 906/1802] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:10 2022] DELETE /identity/v3/projects/1f787a7fdddd4a44be988f667b942eee => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:11.219311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d3dc-233a-4866-b8d3-e7b3c951633f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:11.219868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d3dc-233a-4866-b8d3-e7b3c951633f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:11.220512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d3dc-233a-4866-b8d3-e7b3c951633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:11.246578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:11.248054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:11.302905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ca41d3dc-233a-4866-b8d3-e7b3c951633f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:11.310267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca41d3dc-233a-4866-b8d3-e7b3c951633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:11.462425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afe4fc-59b8-42e1-a626-2c1cbc44c063 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:11.479065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:11.480283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:11.483264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:11.483850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:11.491111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:11.515284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 897/1803] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:11.523125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:11.523911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:11.524116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:11.524518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:11.528465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:11.562222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 907/1804] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:57:11.580033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:11.581310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:11.584608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:11.586342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:11.614686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 898/1805] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:11.615705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:11.634087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69a468-44a4-46d0-8483-24d408e52ee3 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:11.655510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:11.657467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:11.658316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:11.660022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa10c6-920c-45d3-acdf-ffac8b1b84d3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:11.662779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] PATH_INFO: `/v3/projects/bed43c202d754c3fb55e4feb836b215f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:11.669570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed43c202d754c3fb55e4feb836b215f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:11.684041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:11.685659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:11.690130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:11.691246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:11.691976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:11.693366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:11.693717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:11.695511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:11.760911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 899/1806] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:11.768499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:11.826384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:11.827190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b065-4671-4ccc-a81b-d5b8a36a2f02 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:11.901631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed43c202d754c3fb55e4feb836b215f', 'request_id': 'req-2b91a72b-e3be-4540-a73c-f263e8dd1cab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.931761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed43c202d754c3fb55e4feb836b215f', 'request_id': 'req-2b91a72b-e3be-4540-a73c-f263e8dd1cab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:11.944783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed43c202d754c3fb55e4feb836b215f', 'request_id': 'req-2b91a72b-e3be-4540-a73c-f263e8dd1cab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.003229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] The token cache is being invalidate because project bed43c202d754c3fb55e4feb836b215f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:12.003529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.004224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.023670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 908/1807] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:11 2022] DELETE /identity/v3/projects/bed43c202d754c3fb55e4feb836b215f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:12.024567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.024967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.025831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.026349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.026946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.029212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.033298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.035872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:12.088914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a72b-e3be-4540-a73c-f263e8dd1cab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.101545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 900/1808] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:11 2022] POST /identity/v3/projects => generated 357 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:12.104919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.108244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.109564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.110790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:12.114882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.115452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] PATH_INFO: `/v3/users/c52b933217db4386a2c1d5407205afb9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.121208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52b933217db4386a2c1d5407205afb9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.130917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.301059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52b933217db4386a2c1d5407205afb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.320605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52b933217db4386a2c1d5407205afb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.322076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52b933217db4386a2c1d5407205afb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.348062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd8fd-a02f-4752-b000-1bf7e0833f52 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.362413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52b933217db4386a2c1d5407205afb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.371124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.376922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.379069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.382210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.387373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.399199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.411181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52b933217db4386a2c1d5407205afb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:12.423484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:12.432713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 909/1809] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:12 2022] DELETE /identity/v3/users/c52b933217db4386a2c1d5407205afb9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:12.451491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 901/1810] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:12 2022] POST /identity/v3/users => generated 279 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:12.466311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.469513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:12.784074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c61a-184e-4b89-8d53-6be5aa49fa52 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.802266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.803084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.803560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.805205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.806164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.811944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.846193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 910/1811] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:12.850400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.866886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653250-6a61-4893-9bb5-1a48cddae562 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.884631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.887326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.889554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.889993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.891447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.897440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e417-7efb-40a4-824c-d0a2dfd2c12b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.943114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 902/1812] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:12.944595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.979414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275c3c-c1c1-49c3-a9f5-f2971ad26144 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.993346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.995109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.997849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:13.001391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] PATH_INFO: `/v3/projects/a406e1c5107f4b948eaff69a07afc326/users/dd817e0e02044ec1820ac143200f5b64/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:13.044672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a406e1c5107f4b948eaff69a07afc326, user_id=dd817e0e02044ec1820ac143200f5b64, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:13.048197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:13.095145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 911/1813] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:12 2022] PUT /identity/v3/projects/a406e1c5107f4b948eaff69a07afc326/users/dd817e0e02044ec1820ac143200f5b64/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:13.107155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:13.107793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:13.108273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:13.182740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] MFA Rules not processed for user `dd817e0e02044ec1820ac143200f5b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:13.184508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:13.415205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 903/1814] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:13.419957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:13.425607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:13.560820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113bb7-f231-4723-8c1a-d9ac0767e47e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:13.577267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:13.580604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:13.581069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:13.581458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:13.583897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:13.589335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:13.656358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 912/1815] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:13 2022] POST /identity/v3/projects => generated 355 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:13.660594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:13.699703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ffc1b-753e-4c25-8d4a-74c055387e10 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:13.920450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:13.922397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:13.923752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:13.925466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:13.927161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:13.930163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:13.967868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 904/1816] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:13 2022] POST /identity/v3/users => generated 284 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:13.971606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:13.995517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295d5e3-b8b0-4f31-80ce-9e43c5e4cf64 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.025274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.026045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.033705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.033705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.037647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.047164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.094599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:14.096065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 913/1817] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:14.112647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e51189-7e5c-41a4-8303-947043a9c39a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.154211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.157740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.157963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.158212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] PATH_INFO: `/v3/projects/16f6cd96d705421ba1470a73dddeb852/users/4cbc1ba1acf24ba5a55dc9b2835f6a04/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.203777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f6cd96d705421ba1470a73dddeb852, user_id=4cbc1ba1acf24ba5a55dc9b2835f6a04, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.210673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.244060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 905/1818] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:14 2022] PUT /identity/v3/projects/16f6cd96d705421ba1470a73dddeb852/users/4cbc1ba1acf24ba5a55dc9b2835f6a04/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:14.249381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:14.268508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f232e-bacb-4d12-84fe-6fcf5385df59 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.417283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.418720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.419005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.420451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.421345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.427890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36446e-e0d6-4206-b9d1-6e84a46d375c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.456580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:14.457925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 914/1819] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:14.522645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47f40-2258-4bfa-bc26-db5fdb0f45ad admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.542368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.544272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.544714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.545038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] PATH_INFO: `/v3/projects/16f6cd96d705421ba1470a73dddeb852/users/4cbc1ba1acf24ba5a55dc9b2835f6a04/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.547513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f6cd96d705421ba1470a73dddeb852, user_id=4cbc1ba1acf24ba5a55dc9b2835f6a04, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.551367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.576375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 906/1820] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:14 2022] PUT /identity/v3/projects/16f6cd96d705421ba1470a73dddeb852/users/4cbc1ba1acf24ba5a55dc9b2835f6a04/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:14.588376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.588376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.588376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.647035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] MFA Rules not processed for user `4cbc1ba1acf24ba5a55dc9b2835f6a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:14.648627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:14.763245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:14.790523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 915/1821] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:14 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:14.791102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:14.793203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:14.844827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:14.912681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785300f9-2139-4ee8-ace6-260f745da4f9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.935580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.936275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.936549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.937725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.963254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.964879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.994808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 907/1822] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:14 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:57:15.126216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:15.139080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8e5d-1146-4a52-9f32-0a9894cba314 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:15.150392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:15.151264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:15.151608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:15.152252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:15.257050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:15.258552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e33cd-1de6-4df3-a712-6c5876dcc955 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:15.290506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 916/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:16.131204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:16.135190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:16.303600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289d7-8a13-4e66-9f8f-d6a8df3c3aab service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:16.322079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:16.323405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:16.323769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:16.324113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] PATH_INFO: `/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:16.325525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b634c1a1954f4b139f9ae7196b69d3f8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:16.331020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:16.469177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b634c1a1954f4b139f9ae7196b69d3f8', 'request_id': 'req-42f3eafe-22c3-429c-bcc2-233bac8d64a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:16.490877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b634c1a1954f4b139f9ae7196b69d3f8', 'request_id': 'req-42f3eafe-22c3-429c-bcc2-233bac8d64a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:16.504137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b634c1a1954f4b139f9ae7196b69d3f8', 'request_id': 'req-42f3eafe-22c3-429c-bcc2-233bac8d64a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:16.528195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] The token cache is being invalidate because project b634c1a1954f4b139f9ae7196b69d3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:16.528491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:16.529186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-42f3eafe-22c3-429c-bcc2-233bac8d64a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:16.534545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 908/1824] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:16 2022] DELETE /identity/v3/projects/b634c1a1954f4b139f9ae7196b69d3f8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:16.536269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:16.536756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:16.536833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:16.573279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:16.589957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:16.799149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 917/1825] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:16.808624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:16.809193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:16.809665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:16.852408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:16.854532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:16.883417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:16.890594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 909/1826] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:16.895995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e5a3-cc91-4be4-8eb4-3e33091c7109 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:16.909298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:16.909986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:16.910325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:16.910611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:16.911463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:16.911707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:16.914987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:16.949634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:16.957687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 918/1827] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:16.965290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20014-f701-4687-9268-3dc20206de92 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:16.974878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:16.975621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:16.975934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:16.976244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:16.977006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:16.986185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531384b-9b2f-4e99-9608-8653bbec12f0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:17.050804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:17.058478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 910/1828] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:16 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:17.064660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7f3f-e655-4800-99e7-37c83cac4685 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:17.088099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fba4a-00cf-45bb-a3ce-3e69c4c54a98 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.088766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fba4a-00cf-45bb-a3ce-3e69c4c54a98 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.089296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fba4a-00cf-45bb-a3ce-3e69c4c54a98 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.091884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 911/1829] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:57:17.137419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.138205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.138205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.208383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:17.209661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:17.305891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:17.343217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:17.343964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.344269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.344565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.354763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:17.356756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:17.410549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 919/1830] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:17 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:17.412070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:17.437002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef549b-2445-41e5-bab9-be9ea4421ddf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:17.457820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:17.458652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.458871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.459151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.459898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:17.464594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:17.465582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 912/1831] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:57:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:17.496097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 920/1832] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:17.500413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:17.515494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce201614-6c1f-4979-b124-0c9816575694 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:17.529875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:17.531371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.532414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.532955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.533998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:17.536940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5fc6-1d1b-476c-8972-91933c375d41 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:17.559894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 913/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:17.564485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:17.574690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:17.597669 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e438ee9-d58a-4ff2-976d-dc924c2c5dbc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:17.611132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:17.613316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.616627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.617293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] PATH_INFO: `/v3/projects/2adddc6e6bf44b1d9845685a0374e0b3/users/e5d1d9e7f7734c80b92b75d4366a4332/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.652640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adddc6e6bf44b1d9845685a0374e0b3, user_id=e5d1d9e7f7734c80b92b75d4366a4332, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:17.666151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:17.711402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 921/1834] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:17 2022] PUT /identity/v3/projects/2adddc6e6bf44b1d9845685a0374e0b3/users/e5d1d9e7f7734c80b92b75d4366a4332/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:17.713151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334635-b714-452d-bffd-f7c062348b6c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:17.713426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334635-b714-452d-bffd-f7c062348b6c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:17.714035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96334635-b714-452d-bffd-f7c062348b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:17.821943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-96334635-b714-452d-bffd-f7c062348b6c None None] MFA Rules not processed for user `e5d1d9e7f7734c80b92b75d4366a4332`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:17.823731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-96334635-b714-452d-bffd-f7c062348b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:18.042911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 914/1835] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:18.047016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.172945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2273e2-a73e-4a20-8159-3164595f03bb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.186687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.187375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.188383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.188383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.188752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.190588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.228384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96334635-b714-452d-bffd-f7c062348b6c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.230197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-96334635-b714-452d-bffd-f7c062348b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:18.243664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 922/1836] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:18 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:18.244555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.384780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdfde4-b619-48e8-a0d1-505c871e68ba admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.399007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.400088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.400379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.400665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.400988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96334635-b714-452d-bffd-f7c062348b6c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.401430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.403350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.439466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 923/1837] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:18 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:18.447493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.468541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f6137-edc5-4cdd-addc-6ed5f4e7daf4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.477342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:18.484149 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.484875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.485317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.485486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.486354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.487967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.512818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 924/1838] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:18.513775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.540825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c998b5-f995-46f9-8d77-b4e42e1103e7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.547955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.548874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.549255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.549441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] PATH_INFO: `/v3/projects/0d633bbc6c29406d82deff079db292eb/users/376cbd3da4984bc78667f1ba45e69a67/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.556503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.557198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.557481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.557758 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.578430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.580073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.588627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d633bbc6c29406d82deff079db292eb, user_id=376cbd3da4984bc78667f1ba45e69a67, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.591357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.604337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 915/1839] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:57:18.618372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 925/1840] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:18 2022] PUT /identity/v3/projects/0d633bbc6c29406d82deff079db292eb/users/376cbd3da4984bc78667f1ba45e69a67/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:18.619356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.635842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6a375-f43a-45ef-99bd-c025e19b1269 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.777188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.779145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.781622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.782764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.785258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.791132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009aa2-9c31-4326-9763-4601fdc2ecf9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.832594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 916/1841] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:18.834392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:18.846059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19f75-34b9-402d-a09c-e74aa73fc659 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:18.862235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:18.864095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.866010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.867223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] PATH_INFO: `/v3/projects/0d633bbc6c29406d82deff079db292eb/users/376cbd3da4984bc78667f1ba45e69a67/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.871940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d633bbc6c29406d82deff079db292eb, user_id=376cbd3da4984bc78667f1ba45e69a67, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:18.878810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:18.911589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 926/1842] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:18 2022] PUT /identity/v3/projects/0d633bbc6c29406d82deff079db292eb/users/376cbd3da4984bc78667f1ba45e69a67/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:18.928422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c984-13d8-496d-8e57-8c9a365304dd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:18.928625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c984-13d8-496d-8e57-8c9a365304dd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:18.928914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c984-13d8-496d-8e57-8c9a365304dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:18.986741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9932c984-13d8-496d-8e57-8c9a365304dd None None] MFA Rules not processed for user `376cbd3da4984bc78667f1ba45e69a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:18.988270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9932c984-13d8-496d-8e57-8c9a365304dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:19.220328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 917/1843] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:19.238232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:19.242984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:19.255997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:19.412934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3295d8-a7ed-4454-a321-491bd4d5d293 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:19.425798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:19.429102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:19.429416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:19.429703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:19.461210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:19.469501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:19.502908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 927/1844] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:19.599135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:19.599638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:19.599811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:19.667791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] MFA Rules not processed for user `1c758cb7b97a4a63aa7ddd5d2561ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:19.670917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:19.737646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:19.744189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:19.759432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef55-4d40-47fa-ab0d-6568d78868d9 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:19.771750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:19.772641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:19.772929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:19.773211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:19.813149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 918/1845] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:19.815193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:19.816107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:19.887893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:19.890393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:19.904443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 928/1846] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:19.951185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a802bf-161c-4a5e-86b2-394b1818beb1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:19.960974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:19.962833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:19.963679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:19.964192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:19.975835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.002523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.058451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 919/1847] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:19 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:20.062210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.088640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e8d7-042c-42e2-a3f0-57bbe5c71482 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.237660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.238867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.239244 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.241270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.245217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.258864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.289779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 929/1848] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:20 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:20.293225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.312007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61bbf-57bd-4f64-b012-11057aaa5e20 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.318061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.319031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.319504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.319928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.320820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.323107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.338321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 920/1849] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:20.342387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.356988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4515100-6d28-42fc-9d0c-882fa8ae8f05 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.370379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.370379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.370379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.370379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] PATH_INFO: `/v3/projects/01d88d4faca84007929507471480ff86/users/aca0b27136034bb9bf0896d2d6632865/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.382282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d88d4faca84007929507471480ff86, user_id=aca0b27136034bb9bf0896d2d6632865, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.384926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.392263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.408989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2f0d-037c-4cff-a8b1-e33beedf9624 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.418636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 930/1850] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:20 2022] PUT /identity/v3/projects/01d88d4faca84007929507471480ff86/users/aca0b27136034bb9bf0896d2d6632865/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:20.428688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.460247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:20.543387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b568d-899a-43be-ac75-3160c90bd374 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.552203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.552362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.553231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.553529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.553876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.554350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] PATH_INFO: `/v3/users/e5d1d9e7f7734c80b92b75d4366a4332` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.554706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.556020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d1d9e7f7734c80b92b75d4366a4332)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.556402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.558328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.558839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.562390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1681-e535-4427-b422-f8e9b6cef0c9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.587384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 931/1851] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:20.588802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178ee4-1463-491b-8e62-8ad53b180eb3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.589097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178ee4-1463-491b-8e62-8ad53b180eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.589375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178ee4-1463-491b-8e62-8ad53b180eb3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.591119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 932/1852] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:57:20.591909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52178ee4-1463-491b-8e62-8ad53b180eb3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.619676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52178ee4-1463-491b-8e62-8ad53b180eb3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.632070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.633089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.634508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.634988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] PATH_INFO: `/v3/projects/01d88d4faca84007929507471480ff86/users/aca0b27136034bb9bf0896d2d6632865/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.643954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d88d4faca84007929507471480ff86, user_id=aca0b27136034bb9bf0896d2d6632865, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:20.652926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481476c-9ee8-41ed-a3be-a9829083477e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:20.657144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d1d9e7f7734c80b92b75d4366a4332'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:20.659809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:20.673831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d1d9e7f7734c80b92b75d4366a4332'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:20.675224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d1d9e7f7734c80b92b75d4366a4332'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:20.689286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d1d9e7f7734c80b92b75d4366a4332'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:20.698173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 933/1853] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:20 2022] PUT /identity/v3/projects/01d88d4faca84007929507471480ff86/users/aca0b27136034bb9bf0896d2d6632865/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:20.699725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.700014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.700293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.722203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-22f19a53-820b-4ef4-bf95-d392afe8e538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d1d9e7f7734c80b92b75d4366a4332'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:20.731829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:20.734320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:20.736266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 921/1854] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:20 2022] DELETE /identity/v3/users/e5d1d9e7f7734c80b92b75d4366a4332 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:20.743187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.743490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.743842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:20.839020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:20.840327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:20.889361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 934/1855] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:57:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:20.910618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:20.912759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:20.954639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c70c-e651-4c49-9f90-4cef5cede437 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:20.977120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:20.977120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:20.977120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:20.977120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:21.022345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:21.026272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:21.039181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 922/1856] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:21.049794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 935/1857] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:21.115660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:21.118617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:21.217394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af708128-24e1-4e9a-b9ce-287c426263e8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:21.223560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:21.224419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:21.224711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:21.224987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:21.241019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:21.245609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a803b-99ba-40a1-b17e-fbbf8316348e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:21.261972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 923/1858] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:22.458553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:22.460047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:22.503439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63e2e-86d1-4db5-9bf0-4275790af405 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:22.516359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:22.517506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:22.519009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:22.519459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] PATH_INFO: `/v3/projects/2adddc6e6bf44b1d9845685a0374e0b3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:22.522214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adddc6e6bf44b1d9845685a0374e0b3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:22.525673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:22.610733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adddc6e6bf44b1d9845685a0374e0b3', 'request_id': 'req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.624302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adddc6e6bf44b1d9845685a0374e0b3', 'request_id': 'req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.643895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adddc6e6bf44b1d9845685a0374e0b3', 'request_id': 'req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.651456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:22.658543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] The token cache is being invalidate because project 2adddc6e6bf44b1d9845685a0374e0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:22.659071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.660447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.663358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 936/1859] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:22 2022] DELETE /identity/v3/projects/2adddc6e6bf44b1d9845685a0374e0b3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:22.674913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6e51-5492-4b28-a328-6f544cc841e4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:22.675440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6e51-5492-4b28-a328-6f544cc841e4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:22.675440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6e51-5492-4b28-a328-6f544cc841e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:22.676575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:22.678523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:22.740388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5dcb6e51-5492-4b28-a328-6f544cc841e4 None None] MFA Rules not processed for user `aca0b27136034bb9bf0896d2d6632865`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:22.742520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5dcb6e51-5492-4b28-a328-6f544cc841e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:22.797579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af1bf5-33e7-4d30-a8e4-6254a1d8dcbb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:22.812732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:22.813635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:22.813918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:22.814335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] PATH_INFO: `/v3/users/376cbd3da4984bc78667f1ba45e69a67` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:22.821510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=376cbd3da4984bc78667f1ba45e69a67)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:22.823617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:22.869470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:22.899202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 924/1860] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:22.912988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:22.912988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:22.912988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:22.932578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376cbd3da4984bc78667f1ba45e69a67'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.960601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376cbd3da4984bc78667f1ba45e69a67'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.964119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376cbd3da4984bc78667f1ba45e69a67'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:22.974071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] MFA Rules not processed for user `1c758cb7b97a4a63aa7ddd5d2561ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:22.975877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:22.994765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376cbd3da4984bc78667f1ba45e69a67'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.045610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376cbd3da4984bc78667f1ba45e69a67'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.060447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 937/1861] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:22 2022] DELETE /identity/v3/users/376cbd3da4984bc78667f1ba45e69a67 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:23.081001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 925/1862] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:23.204326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:23.206073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:23.294408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a3b-7b73-44aa-96e3-ef662f9dc4bc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:23.300258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:23.300976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.301297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.301582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.303565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:23.314172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:23.372168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:23.373753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc977f-2849-48a4-a4cf-0d48c290fc46 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:23.383128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 938/1863] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:23.442218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:23.443522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:23.463393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443d13d-a287-4bbb-bda2-8db00b51d901 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:23.551313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:23.552737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.553022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.553300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] PATH_INFO: `/v3/projects/0d633bbc6c29406d82deff079db292eb` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.555203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d633bbc6c29406d82deff079db292eb)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:23.556526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:23.616130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d633bbc6c29406d82deff079db292eb', 'request_id': 'req-071c4687-22b0-4605-b394-fc7a08272633'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.628028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d633bbc6c29406d82deff079db292eb', 'request_id': 'req-071c4687-22b0-4605-b394-fc7a08272633'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.636515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d633bbc6c29406d82deff079db292eb', 'request_id': 'req-071c4687-22b0-4605-b394-fc7a08272633'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.651137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] The token cache is being invalidate because project 0d633bbc6c29406d82deff079db292eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:23.651630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.652495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071c4687-22b0-4605-b394-fc7a08272633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:23.657560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 926/1864] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:23 2022] DELETE /identity/v3/projects/0d633bbc6c29406d82deff079db292eb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:23.659474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.659979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.659979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.682432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:23.684678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:23.757633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 939/1865] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:23.765283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.765764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.765867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.790022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:23.791479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:23.806856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 927/1866] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:23.806994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:23.819552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697603-543d-44b9-b35f-573f922336d8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:23.826098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:23.827003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.827464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.828128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.829042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:23.829526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:23.831837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:23.847241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 940/1867] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:23.852062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:23.862783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e0cd-7fbf-45eb-80fb-96832eb757bd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:23.874536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:23.875496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:23.876178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:23.876518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:23.877212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:23.880077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:23.910289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:23.919012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 928/1868] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:23 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:23.922961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:23.933982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7703-0538-40c9-b087-507602c34623 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:24.013912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:24.014707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.015060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.015409 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.016202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:24.018297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:24.050301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 941/1869] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:23 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:24.054664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:24.071054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4914d-ded9-4605-b632-ce88c1d9593f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:24.076632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:24.077453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.077660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.078075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.078929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:24.080945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:24.096067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 929/1870] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:24.099976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:24.116160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f920e-6f11-4aab-8fe5-e164fa7d70a2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:24.132888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:24.134195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.134195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.134195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.134859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:24.136442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9a34-ee16-46ce-ace4-9a1c8bf236b9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:24.173900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 942/1871] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:24.175511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:24.193057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d71c-1133-4664-9bcf-567a908d73b5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:24.198389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:24.199399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.199753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.201067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] PATH_INFO: `/v3/projects/bacd6af05ce640a7b10370e45b998f7e/users/cc7755e0ddc44f78a05f999c917c5004/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.238418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacd6af05ce640a7b10370e45b998f7e, user_id=cc7755e0ddc44f78a05f999c917c5004, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:24.242800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:24.264275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 930/1872] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:24 2022] PUT /identity/v3/projects/bacd6af05ce640a7b10370e45b998f7e/users/cc7755e0ddc44f78a05f999c917c5004/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:24.275637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.275933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.276215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.309116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] MFA Rules not processed for user `cc7755e0ddc44f78a05f999c917c5004`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:24.310395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:24.316132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:24.440784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 943/1873] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:24.460596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:24.463900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:24.569826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a3ef-41ba-4515-a4a7-3e4ad1af1f0a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:24.569826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:24.569826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:24.569826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:24.570379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:24.596303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:24.604381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61695b9-4cad-47dd-bcec-26dc065176a7 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:24.627103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 931/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:27.350662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:27.421222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67031398-c69d-4de5-817a-b521a4fce5c5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:27.426914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:27.427794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:27.428082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:27.428354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] PATH_INFO: `/v3/users/cc7755e0ddc44f78a05f999c917c5004` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:27.429558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7755e0ddc44f78a05f999c917c5004)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:27.431503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:27.487569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7755e0ddc44f78a05f999c917c5004'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:27.497452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7755e0ddc44f78a05f999c917c5004'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:27.498320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7755e0ddc44f78a05f999c917c5004'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:27.508683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7755e0ddc44f78a05f999c917c5004'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:27.522177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7755e0ddc44f78a05f999c917c5004'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:27.531602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 944/1875] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:27 2022] DELETE /identity/v3/users/cc7755e0ddc44f78a05f999c917c5004 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:27.536544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:27.537047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:27.537145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:27.554580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:27.555843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:27.637300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 932/1876] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:27.667086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:27.668524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:27.701035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:27.733170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545248-31d8-4005-8476-90f74a6bca99 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:27.736907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:27.737650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:27.738027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:27.738413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:27.748687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:27.750134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028017a2-4081-489f-9b6b-3c4361a1643d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:27.760185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 945/1877] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:28.021311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.022860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:28.036829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540e7b-c711-4837-be05-7e6a900f6028 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.041586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.042775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.043162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.043592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] PATH_INFO: `/v3/projects/bacd6af05ce640a7b10370e45b998f7e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.044912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacd6af05ce640a7b10370e45b998f7e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.046960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.101638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacd6af05ce640a7b10370e45b998f7e', 'request_id': 'req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:28.115150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacd6af05ce640a7b10370e45b998f7e', 'request_id': 'req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:28.125886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:28.127005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacd6af05ce640a7b10370e45b998f7e', 'request_id': 'req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:28.141210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] The token cache is being invalidate because project bacd6af05ce640a7b10370e45b998f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:28.141500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:28.142214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2bcc21e8-e555-4c0e-b9b4-4e5df89cb934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:28.143761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 933/1878] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:28 2022] DELETE /identity/v3/projects/bacd6af05ce640a7b10370e45b998f7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:28.149284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.149782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.150102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.168049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:28.169723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:28.239470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 946/1879] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:28.248311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.248602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.248883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.267319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:28.268533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:28.277573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 934/1880] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:28.282139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.292875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9771-cb6a-4409-b697-6b249d1f2bb8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.297395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.298056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.298370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.298645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.299372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:28.299679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.301443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.313456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 947/1881] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:28.317850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.327296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ce3c-71e3-4f96-966f-b6819e888ece None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.332019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.333199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.333482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.333769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.334483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.336376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.370354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 935/1882] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:28.374431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.384507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc3cd-9b0a-496b-b951-997a4b5de069 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.449547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.450379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.451288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.451288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.451674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.453627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.477679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 948/1883] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:28.481538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.493477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e1e5a-c4bf-4fad-9f2b-718f8f7cf0f3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.498961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.499362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.499780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.500162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.501464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.502866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.517876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 936/1884] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:28.519201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.534188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e292b-b78d-47d6-b4d3-10cddc1ddee3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.543655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.544346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.544628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.544901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.546429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.547762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbf43-9e8d-465b-8dc9-20951a0ce373 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.583017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 949/1885] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:28.584148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.594783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446aed-d322-4445-8096-13844cdf704b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.599645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.600675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.601024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.601388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] PATH_INFO: `/v3/projects/cd3a8b9661ff4ca790a06e018b3ca13d/users/1ddaccfbfc794a2cb31f939c73d24f43/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.620296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3a8b9661ff4ca790a06e018b3ca13d, user_id=1ddaccfbfc794a2cb31f939c73d24f43, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.623859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.641014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 937/1886] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:28 2022] PUT /identity/v3/projects/cd3a8b9661ff4ca790a06e018b3ca13d/users/1ddaccfbfc794a2cb31f939c73d24f43/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:28.652037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87521f4-9663-4566-823d-7b0d12ea7021 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.652329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87521f4-9663-4566-823d-7b0d12ea7021 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.652608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87521f4-9663-4566-823d-7b0d12ea7021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.683389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c87521f4-9663-4566-823d-7b0d12ea7021 None None] MFA Rules not processed for user `1ddaccfbfc794a2cb31f939c73d24f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:28.684726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c87521f4-9663-4566-823d-7b0d12ea7021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:28.715881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:28.764232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 950/1887] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:28.776214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:28.778521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:28.839689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568c0e-34e6-44a1-965b-fef3832f0cff admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:28.844122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:28.844664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.845026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.845503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.860110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:28.861619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf4ee-ccce-4950-8717-65b8e61a68c8 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:28.871533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 938/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:28.922370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.923416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.923700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.925249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 951/1889] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:57:28.951370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:28.951615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:28.952012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:28.977579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:28.978906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:29.069603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 939/1890] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:29.100242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:29.102025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:29.148681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea31c-5f86-4122-b4aa-1488d4de2065 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:29.163452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:29.164125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:29.164458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:29.164753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:29.187422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:29.188786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4a5fb-5015-422c-8e58-d70c1999e520 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:29.209032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 952/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:32.582037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:32.583859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:32.617428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:32.661243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56304db2-db8e-43ea-82c2-0e128bdc1321 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:32.668116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:32.669315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:32.669708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:32.670060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] PATH_INFO: `/v3/users/dd817e0e02044ec1820ac143200f5b64` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:32.671496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd817e0e02044ec1820ac143200f5b64)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:32.673695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:32.758247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd817e0e02044ec1820ac143200f5b64'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:32.769925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd817e0e02044ec1820ac143200f5b64'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:32.771866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd817e0e02044ec1820ac143200f5b64'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:32.782301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd817e0e02044ec1820ac143200f5b64'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:32.804814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd817e0e02044ec1820ac143200f5b64'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:32.815658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 940/1892] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:32 2022] DELETE /identity/v3/users/dd817e0e02044ec1820ac143200f5b64 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:32.821507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:32.822588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:32.822879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:32.852005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:32.853372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:32.933138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 953/1893] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:32.948241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:32.949659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:33.012312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905cfe1-8bc7-4e92-9f05-59f350653f62 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:33.015891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:33.016531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:33.016812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:33.017085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:33.026267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:33.027783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:33.037546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 941/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:33.303168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:33.304565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:33.319081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a38f7-50a2-491e-a431-49f2b1c16e95 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:33.324328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:33.325419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:33.325672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:33.325954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] PATH_INFO: `/v3/projects/a406e1c5107f4b948eaff69a07afc326` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:33.327166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a406e1c5107f4b948eaff69a07afc326)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:33.329081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:33.412497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a406e1c5107f4b948eaff69a07afc326', 'request_id': 'req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.420821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a406e1c5107f4b948eaff69a07afc326', 'request_id': 'req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.427763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a406e1c5107f4b948eaff69a07afc326', 'request_id': 'req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.438181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] The token cache is being invalidate because project a406e1c5107f4b948eaff69a07afc326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:33.438477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.439236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.440969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 954/1895] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:33 2022] DELETE /identity/v3/projects/a406e1c5107f4b948eaff69a07afc326 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:33.445715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:33.456863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bde631-c0d5-4ccb-a03d-db75a9aee7ce service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:33.499660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:33.515586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:33.516487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:33.516765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:33.517040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] PATH_INFO: `/v3/users/4cbc1ba1acf24ba5a55dc9b2835f6a04` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:33.518245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbc1ba1acf24ba5a55dc9b2835f6a04)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:33.520200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:33.568471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbc1ba1acf24ba5a55dc9b2835f6a04'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.575963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbc1ba1acf24ba5a55dc9b2835f6a04'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.577811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbc1ba1acf24ba5a55dc9b2835f6a04'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.585214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbc1ba1acf24ba5a55dc9b2835f6a04'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.597218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-35d04a3c-39fd-47aa-b247-9e4143a3ffba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbc1ba1acf24ba5a55dc9b2835f6a04'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:33.603511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 942/1896] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:33 2022] DELETE /identity/v3/users/4cbc1ba1acf24ba5a55dc9b2835f6a04 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:34.050488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.052722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:34.084179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15af6f-abc2-46df-bd7f-3ceb3e7eee36 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.120418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:34.153308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.154253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.154538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.154817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] PATH_INFO: `/v3/projects/16f6cd96d705421ba1470a73dddeb852` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.156006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f6cd96d705421ba1470a73dddeb852)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.157941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.205552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f6cd96d705421ba1470a73dddeb852', 'request_id': 'req-f8a9faf8-df73-4dec-a870-b130f33835a8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:34.213351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f6cd96d705421ba1470a73dddeb852', 'request_id': 'req-f8a9faf8-df73-4dec-a870-b130f33835a8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:34.219601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f6cd96d705421ba1470a73dddeb852', 'request_id': 'req-f8a9faf8-df73-4dec-a870-b130f33835a8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:34.230725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] The token cache is being invalidate because project 16f6cd96d705421ba1470a73dddeb852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:34.231015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:34.231647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f8a9faf8-df73-4dec-a870-b130f33835a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:34.233220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 955/1897] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:34 2022] DELETE /identity/v3/projects/16f6cd96d705421ba1470a73dddeb852 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:34.238177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d9721-a735-417e-ab96-3f73817effca None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.238505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d9721-a735-417e-ab96-3f73817effca None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.238786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d9721-a735-417e-ab96-3f73817effca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.256704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-566d9721-a735-417e-ab96-3f73817effca None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:34.257917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-566d9721-a735-417e-ab96-3f73817effca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:34.319170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 943/1898] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:34.327082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.327372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.327651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.346290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:34.347505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:34.355914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 956/1899] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:34.360048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d9721-a735-417e-ab96-3f73817effca None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.369587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d9721-a735-417e-ab96-3f73817effca None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.374075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.374777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.375058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.375330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.376047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:34.376350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.377923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.388992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 944/1900] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:34.393085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.402963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde1def-f6a3-42ee-a592-4ba92437b846 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.407495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.408144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.408433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.408710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.409438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.412009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.436096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 957/1901] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:34.440020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.450630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfc637-8a09-47c4-91b6-97758d7475b7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.499870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:34.512448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.513404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.513773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.514053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.514785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.516820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.539806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 945/1902] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:34.543977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.554765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac0bd-a8f0-4117-967b-bb89c57004f2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.559662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.560340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.560775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.561059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.561827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.563550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.576386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 958/1903] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:34.580239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.591075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8868fc-143d-434e-bd58-e1bd87b8c3a9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.596004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.596681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.596968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.597249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.598023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.599662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10a65b-6770-433a-9e28-9ab27e40e6bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.610973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 946/1904] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:57:34.615782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.635885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91200585-2fca-48ed-8753-4685f57b3d5a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.644347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.645880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.646196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.646483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] PATH_INFO: `/v3/projects/ef29c5383639412ca51b6df5929e0687/users/f72eee5813714a00b9586582cb808e37/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.668628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef29c5383639412ca51b6df5929e0687, user_id=f72eee5813714a00b9586582cb808e37, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.672274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.691496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 959/1905] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:34 2022] PUT /identity/v3/projects/ef29c5383639412ca51b6df5929e0687/users/f72eee5813714a00b9586582cb808e37/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:34.702790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.703164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.703422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.744210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] MFA Rules not processed for user `f72eee5813714a00b9586582cb808e37`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:34.745675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:34.864452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 947/1906] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:34.868755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:34.978749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9b33-633c-4e98-8f14-8d7e5ccbb049 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:34.985467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:34.985467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:34.985467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:34.985741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:34.986277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:34.988186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:34.994286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:35.025801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 960/1907] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:34 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:35.029586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.042660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e0d2-c08f-4b9d-9c83-8a17195b6ee5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.165471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.167024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.167542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.167913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.168820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.171150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.202341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 948/1908] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:35 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:35.205076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.217689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd44c6-3ecd-485c-bae8-06ff4c0e971d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.224293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.225112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.225468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.225822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.226701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.228414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.244816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 961/1909] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:35.247595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.260512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7062-dfc5-4764-97c4-05256c390744 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.267556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.268500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.274819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.275159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] PATH_INFO: `/v3/projects/f3f7945f069a484a950944f8075251a2/users/f4e679a2710142f1abf19947b6c66e54/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.294453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f7945f069a484a950944f8075251a2, user_id=f4e679a2710142f1abf19947b6c66e54, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.297579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.319776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 949/1910] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:35 2022] PUT /identity/v3/projects/f3f7945f069a484a950944f8075251a2/users/f4e679a2710142f1abf19947b6c66e54/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:35.323925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.336441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95414d6-1ed9-4677-93c1-f0806788afe6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.447169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.447844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.448847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.449301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.450192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.453807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06c31-8d00-4f86-a49d-a3a82e869e78 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.476266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 962/1911] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:35.477823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.489115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ba5bd-883f-4991-b462-b7508de13fab admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.494698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.496386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.496736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.497087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] PATH_INFO: `/v3/projects/f3f7945f069a484a950944f8075251a2/users/f4e679a2710142f1abf19947b6c66e54/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.499358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f7945f069a484a950944f8075251a2, user_id=f4e679a2710142f1abf19947b6c66e54, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.502749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.517303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 950/1912] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:35 2022] PUT /identity/v3/projects/f3f7945f069a484a950944f8075251a2/users/f4e679a2710142f1abf19947b6c66e54/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:35.535541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.536190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.536694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.572550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] MFA Rules not processed for user `f4e679a2710142f1abf19947b6c66e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:35.573803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:35.656167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 963/1913] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:35.669831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.672929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:35.700717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:35.759057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844b414-d261-42a1-9d5b-1cc01e377b84 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.763710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.764295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.764763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.765101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:35.776216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:35.777845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247953c-721e-45f0-a325-01482e0254ae service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:35.789355 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 951/1914] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:35.924353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:35.986874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:35.991802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513f452-e467-402c-8ea2-5bcd62579360 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:35.997727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:35.998935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:35.999221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:35.999501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] PATH_INFO: `/v3/users/f72eee5813714a00b9586582cb808e37` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:36.000704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72eee5813714a00b9586582cb808e37)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:36.003022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:36.049739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72eee5813714a00b9586582cb808e37'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.056712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72eee5813714a00b9586582cb808e37'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.057367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72eee5813714a00b9586582cb808e37'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.064154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72eee5813714a00b9586582cb808e37'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.076350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72eee5813714a00b9586582cb808e37'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.082691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 964/1915] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:35 2022] DELETE /identity/v3/users/f72eee5813714a00b9586582cb808e37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:36.087219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:36.087510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:36.087789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:36.107675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:36.110187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:36.178647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 952/1916] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:36.188474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:36.189875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:36.266604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd508d-25fe-41be-a540-7d35bb08b305 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:36.271241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:36.271898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:36.272186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:36.272465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:36.284148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:36.286374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:36.296679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 965/1917] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:57:36.754962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:36.756478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:36.782164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa59e-c92e-4a74-a6bc-2597dd214153 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:36.791569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:36.792783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:36.793181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:36.793523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] PATH_INFO: `/v3/projects/ef29c5383639412ca51b6df5929e0687` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:36.794847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef29c5383639412ca51b6df5929e0687)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:36.797505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:36.858685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef29c5383639412ca51b6df5929e0687', 'request_id': 'req-fe3521c7-6096-4896-9685-b9ef7c63363a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.867404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef29c5383639412ca51b6df5929e0687', 'request_id': 'req-fe3521c7-6096-4896-9685-b9ef7c63363a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.874193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef29c5383639412ca51b6df5929e0687', 'request_id': 'req-fe3521c7-6096-4896-9685-b9ef7c63363a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.898821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] The token cache is being invalidate because project ef29c5383639412ca51b6df5929e0687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:36.899818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.900574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:36.910235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 953/1918] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:36 2022] DELETE /identity/v3/projects/ef29c5383639412ca51b6df5929e0687 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:36.911716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:36.927734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd05b0-7400-4262-8cf2-f36bf5f70138 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:37.030344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:37.030344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:37.030646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:37.030813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] PATH_INFO: `/v3/users/f4e679a2710142f1abf19947b6c66e54` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:37.032242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e679a2710142f1abf19947b6c66e54)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:37.034516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:37.059168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:37.103389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e679a2710142f1abf19947b6c66e54'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.112065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e679a2710142f1abf19947b6c66e54'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.112775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e679a2710142f1abf19947b6c66e54'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.119877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e679a2710142f1abf19947b6c66e54'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.131540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7ef521c6-2926-4e08-85c9-d6d91773cd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e679a2710142f1abf19947b6c66e54'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.137461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 966/1919] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:36 2022] DELETE /identity/v3/users/f4e679a2710142f1abf19947b6c66e54 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:37.706506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:37.708388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:37.723717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3521c7-6096-4896-9685-b9ef7c63363a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:37.774049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:37.808574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:37.809746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:37.810765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:37.811126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] PATH_INFO: `/v3/projects/f3f7945f069a484a950944f8075251a2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:37.812409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f7945f069a484a950944f8075251a2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:37.814449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:37.898488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f7945f069a484a950944f8075251a2', 'request_id': 'req-39a43c94-cbc4-4942-b067-c2cb267a4736'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.907416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f7945f069a484a950944f8075251a2', 'request_id': 'req-39a43c94-cbc4-4942-b067-c2cb267a4736'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.914710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f7945f069a484a950944f8075251a2', 'request_id': 'req-39a43c94-cbc4-4942-b067-c2cb267a4736'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.929412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] The token cache is being invalidate because project f3f7945f069a484a950944f8075251a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:37.929797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.930565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-39a43c94-cbc4-4942-b067-c2cb267a4736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:37.932364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 954/1920] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:37 2022] DELETE /identity/v3/projects/f3f7945f069a484a950944f8075251a2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:37.937099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:37.937958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:37.938413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:37.958078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:37.959491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:38.036787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 967/1921] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:38.046852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.047684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.047684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.068291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:38.069576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:38.084441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.086379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 955/1922] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:38.099180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f974a0-a6bd-439d-be6a-775c3981ac79 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.127224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.127974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.128182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.128480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.129232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:38.129546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.131177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.155071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 968/1923] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:57:38.164639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.185106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f267-1ed6-4255-ac56-3895af3eba46 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.193209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.193902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.194193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.194470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.195158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.197086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.236549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 956/1924] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:38.237286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.250072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81a483-8b58-448c-91dd-e02fb0f3d72f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.335758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.336362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.336650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.336932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.337629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.339580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.367318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 969/1925] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:38.372259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.384121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156535d9-577f-435c-bf5b-f30bf3fccba1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.389903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.390641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.390926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.391203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.391964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.393573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.410443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 957/1926] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:38.410898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.422668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe93f3-55c1-4156-b81c-daf86bfbab9d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.427853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025f218-dc74-4919-b951-892494379555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.428517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025f218-dc74-4919-b951-892494379555 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.430180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025f218-dc74-4919-b951-892494379555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.430180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025f218-dc74-4919-b951-892494379555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.430180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025f218-dc74-4919-b951-892494379555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.431973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025f218-dc74-4919-b951-892494379555 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.446984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 970/1927] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:38.448343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.482655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071fe8f-1dc2-4a19-a7f8-13d16989b4fd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.482655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.482655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.482655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.483123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] PATH_INFO: `/v3/projects/4085fbdfdf6a4ed4a98c6d215897d536/users/7491b0c5cf59448aa8ba5b56fee47f66/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.499569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4085fbdfdf6a4ed4a98c6d215897d536, user_id=7491b0c5cf59448aa8ba5b56fee47f66, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.502321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.515957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 958/1928] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:38 2022] PUT /identity/v3/projects/4085fbdfdf6a4ed4a98c6d215897d536/users/7491b0c5cf59448aa8ba5b56fee47f66/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:38.527007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.527305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.527591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.534418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:38.557615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] MFA Rules not processed for user `7491b0c5cf59448aa8ba5b56fee47f66`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:38.558969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:38.669396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 971/1929] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:38.669600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.739500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0920e-62b3-43e0-a718-a5f5b5f4aae1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.745002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.745688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.745980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.746313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.747076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.749407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.764494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:38.796575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 959/1930] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:38.800557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.822659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681f43-f207-4012-a36f-74c10e3faadb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.936699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.937426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.938008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.938008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.938739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.941154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:38.977350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 972/1931] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:38 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:38.978875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:38.990592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a677a4-ba0e-4643-949f-b92e8eaeef3c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:38.995685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:38.996862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:38.996862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:38.997049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:38.997792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:38.999572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.015933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 960/1932] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:39.016790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.032688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc88919-75cc-4c37-94aa-e9b6d061cd1b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.041239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.043756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.044293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.044767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.046585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.048921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a91f-5c64-446b-8ec7-4df0c53b8fb8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.067472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 973/1933] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:39.071733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.090888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6110-7726-4619-adb8-b9216dfad548 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.096988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.098703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.099104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.099616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] PATH_INFO: `/v3/projects/61c992f170a8466db340ac1d9235b472/users/8b14a3c76e8349a7bca416c0a9dd25e1/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.127694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c992f170a8466db340ac1d9235b472, user_id=8b14a3c76e8349a7bca416c0a9dd25e1, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.132353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.155411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 961/1934] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:39 2022] PUT /identity/v3/projects/61c992f170a8466db340ac1d9235b472/users/8b14a3c76e8349a7bca416c0a9dd25e1/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:39.167145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.167899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.168183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.211272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] MFA Rules not processed for user `8b14a3c76e8349a7bca416c0a9dd25e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:39.213295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:39.305900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 974/1935] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:39.310064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.381140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4b17-fd4f-4b69-be6b-df497bafe454 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.385860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.386567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.386854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.387132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.387832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.389808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.419587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 962/1936] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:39.423628 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.429813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:39.437304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b2819-7f32-48ad-923f-0d7e9bdfe34f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.505642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.506450 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.506738 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.507019 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.507733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.509994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.537416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 975/1937] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:39 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:57:39.539321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.554566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10198c9a-1fa0-4fbc-9ea6-b2c23c743502 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.559588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.560283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.560570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.560850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.561588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.563238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.577678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 963/1938] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:39.582256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.594171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7fb5-d982-46cc-a5c8-6162dfa54d67 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.600286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.601612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.601860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.602130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] PATH_INFO: `/v3/projects/d4f67c600acd406ba0d138d1049255e0/users/9c9713cad5dc46bfa52c29254dcdbfc7/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.619642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f67c600acd406ba0d138d1049255e0, user_id=9c9713cad5dc46bfa52c29254dcdbfc7, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.622841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.641164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 976/1939] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:39 2022] PUT /identity/v3/projects/d4f67c600acd406ba0d138d1049255e0/users/9c9713cad5dc46bfa52c29254dcdbfc7/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:39.645115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.664332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3b3b-6bd3-46a3-9de2-5a505e34677b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.732715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.733398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.733684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.733963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.734768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.736398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53e167-04e0-485c-b7d0-e38ff0e73302 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.747316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 964/1940] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:39.751111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.761167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556418-8cfa-43c1-9c08-0defd8781c4b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.765713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.766632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.766912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.767189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] PATH_INFO: `/v3/projects/d4f67c600acd406ba0d138d1049255e0/users/9c9713cad5dc46bfa52c29254dcdbfc7/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.769168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f67c600acd406ba0d138d1049255e0, user_id=9c9713cad5dc46bfa52c29254dcdbfc7, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:39.771955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:39.783125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 977/1941] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:39 2022] PUT /identity/v3/projects/d4f67c600acd406ba0d138d1049255e0/users/9c9713cad5dc46bfa52c29254dcdbfc7/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:39.793468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.793765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.794049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:39.821215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] MFA Rules not processed for user `9c9713cad5dc46bfa52c29254dcdbfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:39.822565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:39.834905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:39.893298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 965/1942] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:39.905284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:39.907000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:39.977048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e0c11-55bb-46a8-91ff-6235caef8ec4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:39.981431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:39.982404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:39.982800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:39.983184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:40.055736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:40.057974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:40.083623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 978/1943] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:41.657973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:41.667845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521a6e-f806-4a77-9cdf-ad071e844c4e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:41.671476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:41.672127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:41.672407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:41.672686 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:41.729375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:41.730963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:41.740846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 966/1944] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:42.401877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:42.411675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977403eb-dc28-4fb7-b3d4-1242e144ff32 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:42.420333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:42.421449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:42.422094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:42.422625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:42.431349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:42.434295 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:42.436294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4d50b-f5a9-4da6-a643-53dcbd7a4c31 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:42.449015 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 979/1945] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:46.532497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:46.596090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0695a-d24e-4bad-9dd3-88b47bed0f1b service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:46.601093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:46.601966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:46.602277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:46.602553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] PATH_INFO: `/v3/users/7491b0c5cf59448aa8ba5b56fee47f66` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:46.603738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7491b0c5cf59448aa8ba5b56fee47f66)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:46.605656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:46.670983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7491b0c5cf59448aa8ba5b56fee47f66'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:46.678140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:46.681824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7491b0c5cf59448aa8ba5b56fee47f66'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:46.683118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7491b0c5cf59448aa8ba5b56fee47f66'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:46.695086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7491b0c5cf59448aa8ba5b56fee47f66'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:46.711478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7491b0c5cf59448aa8ba5b56fee47f66'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:46.719519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 967/1946] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:46 2022] DELETE /identity/v3/users/7491b0c5cf59448aa8ba5b56fee47f66 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:46.724354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:46.724816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:46.724952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:46.745671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:46.746949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:46.831179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 980/1947] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:46.842529 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:46.845360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:46.945594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b8eaf-c674-4c04-a72e-4842c94032fa admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:46.950149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:46.951774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:46.951774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:46.952141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:46.965779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:46.967737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:46.985746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 968/1948] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:47.365254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:47.366806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:47.387660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8dcb5-dfc9-44ae-a550-aed18f792aac None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:47.396044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:47.397005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:47.397357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:47.397717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] PATH_INFO: `/v3/projects/4085fbdfdf6a4ed4a98c6d215897d536` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:47.400281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4085fbdfdf6a4ed4a98c6d215897d536)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:47.402213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:47.452237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4085fbdfdf6a4ed4a98c6d215897d536', 'request_id': 'req-699d58e2-3fdb-41fe-a280-70a316b6771a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.460521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4085fbdfdf6a4ed4a98c6d215897d536', 'request_id': 'req-699d58e2-3fdb-41fe-a280-70a316b6771a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.467606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4085fbdfdf6a4ed4a98c6d215897d536', 'request_id': 'req-699d58e2-3fdb-41fe-a280-70a316b6771a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.478926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] The token cache is being invalidate because project 4085fbdfdf6a4ed4a98c6d215897d536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:47.479114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.479841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.481536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 981/1949] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:47 2022] DELETE /identity/v3/projects/4085fbdfdf6a4ed4a98c6d215897d536 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:47.485484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:47.495932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c5f29-c3ed-46c8-84ae-aeb95715c2cb service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:47.555888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:47.556901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:47.557131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:47.557407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] PATH_INFO: `/v3/users/8b14a3c76e8349a7bca416c0a9dd25e1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:47.559689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b14a3c76e8349a7bca416c0a9dd25e1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:47.561670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:47.612326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b14a3c76e8349a7bca416c0a9dd25e1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.620058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b14a3c76e8349a7bca416c0a9dd25e1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.620693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b14a3c76e8349a7bca416c0a9dd25e1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.627665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b14a3c76e8349a7bca416c0a9dd25e1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.635801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:47.643115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b14a3c76e8349a7bca416c0a9dd25e1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:47.650058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 969/1950] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:47 2022] DELETE /identity/v3/users/8b14a3c76e8349a7bca416c0a9dd25e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:47.984916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:47.987400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:48.004651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d58e2-3fdb-41fe-a280-70a316b6771a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:48.100641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:48.101633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:48.102264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:48.102751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] PATH_INFO: `/v3/projects/61c992f170a8466db340ac1d9235b472` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:48.104376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c992f170a8466db340ac1d9235b472)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:48.106672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:48.143457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:48.175556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c992f170a8466db340ac1d9235b472', 'request_id': 'req-2b762e93-f00c-497f-9c8d-2020a615cd60'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.187711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c992f170a8466db340ac1d9235b472', 'request_id': 'req-2b762e93-f00c-497f-9c8d-2020a615cd60'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.208213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c992f170a8466db340ac1d9235b472', 'request_id': 'req-2b762e93-f00c-497f-9c8d-2020a615cd60'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.215115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] The token cache is being invalidate because project 61c992f170a8466db340ac1d9235b472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:48.215366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.216214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.217998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 982/1951] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:47 2022] DELETE /identity/v3/projects/61c992f170a8466db340ac1d9235b472 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:48.222099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:48.224132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:48.237502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629e881-34e5-42fd-94b2-e411d212d966 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:48.350897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:48.351402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:48.351693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:48.351972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] PATH_INFO: `/v3/users/9c9713cad5dc46bfa52c29254dcdbfc7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:48.353490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9713cad5dc46bfa52c29254dcdbfc7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:48.355747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:48.489468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9713cad5dc46bfa52c29254dcdbfc7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.502812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9713cad5dc46bfa52c29254dcdbfc7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.504175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9713cad5dc46bfa52c29254dcdbfc7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.519979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9713cad5dc46bfa52c29254dcdbfc7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.544720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9713cad5dc46bfa52c29254dcdbfc7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.557954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 970/1952] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:48 2022] DELETE /identity/v3/users/9c9713cad5dc46bfa52c29254dcdbfc7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:48.855032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:48.856472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:48.869578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e93-f00c-497f-9c8d-2020a615cd60 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:48.926726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:48.927598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:48.927885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:48.928166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] PATH_INFO: `/v3/projects/d4f67c600acd406ba0d138d1049255e0` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:48.929345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f67c600acd406ba0d138d1049255e0)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:48.931313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:48.978350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f67c600acd406ba0d138d1049255e0', 'request_id': 'req-532660ac-7d8e-4d58-963b-3a7e8ee96791'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.985073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f67c600acd406ba0d138d1049255e0', 'request_id': 'req-532660ac-7d8e-4d58-963b-3a7e8ee96791'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:48.991339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f67c600acd406ba0d138d1049255e0', 'request_id': 'req-532660ac-7d8e-4d58-963b-3a7e8ee96791'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:49.001773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] The token cache is being invalidate because project d4f67c600acd406ba0d138d1049255e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:49.002065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:49.002743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-532660ac-7d8e-4d58-963b-3a7e8ee96791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:49.004890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 983/1953] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:48 2022] DELETE /identity/v3/projects/d4f67c600acd406ba0d138d1049255e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:55.457642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:55.459143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:55.472492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53b7c-c9f3-4d8f-b7dd-ec84d75fbca5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:55.532245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:55.533293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:55.533689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:55.533968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] PATH_INFO: `/v3/users/1ddaccfbfc794a2cb31f939c73d24f43` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:55.535931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddaccfbfc794a2cb31f939c73d24f43)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:55.537853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:55.550825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:55.603366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddaccfbfc794a2cb31f939c73d24f43'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:55.612072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddaccfbfc794a2cb31f939c73d24f43'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:55.613707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddaccfbfc794a2cb31f939c73d24f43'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:55.622956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddaccfbfc794a2cb31f939c73d24f43'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:55.638136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddaccfbfc794a2cb31f939c73d24f43'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:55.645988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 971/1954] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:57:55 2022] DELETE /identity/v3/users/1ddaccfbfc794a2cb31f939c73d24f43 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:55.650564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:55.651052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:55.651152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:55.670196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:55.671828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:55.709183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:55.739216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 984/1955] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:55.748578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:55.750050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:55.809582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d89fa-d8e1-4d10-a73b-daad22e3e72a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:55.813801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:55.814503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:55.814824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:55.815103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:55.825549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:55.827056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e6a48-1bac-47ac-abf4-070b73d6010e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:55.837470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 972/1956] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:56.232931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.234511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:56.246884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab7b4f-cfe8-4a02-978f-eb045ac5a0fb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.252439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.254092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.254407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.254682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] PATH_INFO: `/v3/projects/cd3a8b9661ff4ca790a06e018b3ca13d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.255915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3a8b9661ff4ca790a06e018b3ca13d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.258096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.311342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3a8b9661ff4ca790a06e018b3ca13d', 'request_id': 'req-ded9f327-75b6-4491-8614-3cc49f4fe4e8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:56.319393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3a8b9661ff4ca790a06e018b3ca13d', 'request_id': 'req-ded9f327-75b6-4491-8614-3cc49f4fe4e8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:56.326314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3a8b9661ff4ca790a06e018b3ca13d', 'request_id': 'req-ded9f327-75b6-4491-8614-3cc49f4fe4e8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:56.337671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] The token cache is being invalidate because project cd3a8b9661ff4ca790a06e018b3ca13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:56.337964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:56.338741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ded9f327-75b6-4491-8614-3cc49f4fe4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:56.340338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 985/1957] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:57:56 2022] DELETE /identity/v3/projects/cd3a8b9661ff4ca790a06e018b3ca13d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:56.345114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.345477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.345851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.364366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:56.365671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:56.428003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 973/1958] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:56.433630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.433927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.434246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.453691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:56.454990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:56.463585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 986/1959] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:57:56.467770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.477506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ef98-a250-4af7-be6a-998beba54c66 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.482102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.482817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.483103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.483383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.484107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:57:56.484418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.486011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.497932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 974/1960] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:57:56.502162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.511953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb457d-6a71-4f48-880c-16bc2509fad8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.516529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.517188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.517475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.517756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.518486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.521041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.548915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 987/1961] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:57:56 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:56.554618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.564986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae2e3-f59a-4daa-afb9-f46cfaf3fbfa admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.581560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:57:56.638879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.639798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.640157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.640510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.641284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.644932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.666329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 975/1962] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:57:56 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:57:56.670822 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.683923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5d9b-af0a-46ae-ad79-11aefaec4f4f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.688793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.689459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.689744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.690020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.691384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.693090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.703773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 988/1963] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:56.707931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.718963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516073-fe90-41fa-a3ea-9c95c4a0f2d3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.723757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.724514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.724878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.725429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.726320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.728026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d142b-7567-4a6c-81d5-b8667cb580b8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.739254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 976/1964] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:57:56.743390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.754171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02496df2-80bc-41dd-993d-966519c3e787 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.758654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.759531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.759814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.760087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] PATH_INFO: `/v3/projects/51cd0c3a761c44d4be8a4490584e71f8/users/33e9bce9aa4f485087fb8f564b37058e/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.774801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cd0c3a761c44d4be8a4490584e71f8, user_id=33e9bce9aa4f485087fb8f564b37058e, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.777467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.789622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 989/1965] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:57:56 2022] PUT /identity/v3/projects/51cd0c3a761c44d4be8a4490584e71f8/users/33e9bce9aa4f485087fb8f564b37058e/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:56.799564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b1776-35c9-4c1d-9b79-df8fa0d5885b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.799874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b1776-35c9-4c1d-9b79-df8fa0d5885b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.800631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b1776-35c9-4c1d-9b79-df8fa0d5885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.826816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a02b1776-35c9-4c1d-9b79-df8fa0d5885b None None] MFA Rules not processed for user `33e9bce9aa4f485087fb8f564b37058e`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:57:56.828018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a02b1776-35c9-4c1d-9b79-df8fa0d5885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:56.888663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 977/1966] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:57:56.899556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:56.901192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:56.956906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ac98b-06ab-4488-a5ab-eb35ea4a3c66 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:56.961241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:56.961995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:56.962406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:56.962665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:56.971553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:56.973851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e6349-86d8-4b10-8956-3e03a3ce174b service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:56.982573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 990/1967] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:03.165107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.165588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.165718 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.167191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 978/1968] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:58:03.174991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.175407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.175680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.182119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:03.197771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:03.199120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:03.230887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.232794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:03.273225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 991/1969] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:03.284482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.285911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:03.299157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e4a1-eea5-461f-b1f6-df6a0f34efc9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:03.304928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:03.305575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.305858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.306188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.312017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dd11e-9bcc-4b51-acff-241b06dfb837 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:03.314824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:03.316320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:03.316633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:03.318223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.318536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.318796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] PATH_INFO: `/v3/users/4e3175f2f9394dc58f4b57a3051fea5d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.320027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3175f2f9394dc58f4b57a3051fea5d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:03.321946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:03.326511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 992/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:03.354254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:03.373427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3175f2f9394dc58f4b57a3051fea5d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.380750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3175f2f9394dc58f4b57a3051fea5d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.381387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3175f2f9394dc58f4b57a3051fea5d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.388553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3175f2f9394dc58f4b57a3051fea5d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.402330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf233e34-9653-448a-a751-83a2b5d5b1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3175f2f9394dc58f4b57a3051fea5d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.408502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 979/1971] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:03 2022] DELETE /identity/v3/users/4e3175f2f9394dc58f4b57a3051fea5d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:03.575973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.587050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067a38-9ab4-4a10-8e85-a4e868d4a8be service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:03.643301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:03.644169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.644457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.644741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] PATH_INFO: `/v3/projects/70d7f932420c43bea53486477feb6217` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.646583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d7f932420c43bea53486477feb6217)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:03.648514 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:03.695259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d7f932420c43bea53486477feb6217', 'request_id': 'req-2592f63d-e260-4b05-b7e1-702d8d9c99df'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.702417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d7f932420c43bea53486477feb6217', 'request_id': 'req-2592f63d-e260-4b05-b7e1-702d8d9c99df'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.708917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d7f932420c43bea53486477feb6217', 'request_id': 'req-2592f63d-e260-4b05-b7e1-702d8d9c99df'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.719264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] The token cache is being invalidate because project 70d7f932420c43bea53486477feb6217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:03.719552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.720205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2592f63d-e260-4b05-b7e1-702d8d9c99df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:03.721824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 993/1972] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:03 2022] DELETE /identity/v3/projects/70d7f932420c43bea53486477feb6217 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:03.727436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.727732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.728018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.746278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:03.747482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:03.823376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 980/1973] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:03.831773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.832552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.833303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.854662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:03.855954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:03.872943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 994/1974] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:03.876941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.887844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a8848-5434-453c-84f6-9a3028e38853 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:03.892623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:03.893430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.893721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.893999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.894873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:03.895214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:03.896932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:03.910232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 981/1975] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:03.915234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.925235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa208-4646-4e11-9b6c-58f84b9fff92 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:03.934635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:03.935501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:03.935839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:03.936119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:03.936906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:03.938979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:03.943943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:03.971788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 995/1976] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:03 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:03.976948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:03.994770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8edd1d-468a-4f99-b354-42f4c535c940 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.052382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.053065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.053361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.053623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.054357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.056285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.078217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 982/1977] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:03 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:04.082369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.093186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8363cb-1d96-4006-a97d-f706af437c27 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.097892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.099217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.099501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.099777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.100516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.102186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.117363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 996/1978] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:04.121348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.131587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1a1e8-4066-4d3b-bf45-831c5d2c305e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.136958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.137663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.137949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.138266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.139000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.140585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.151605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 983/1979] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:04.156058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.170466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa3d-340e-4c02-8bf1-beb0f0c4e27b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.172365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.173257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.173541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.173818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] PATH_INFO: `/v3/projects/90e7554316ac42488cbdc3f7e3b61148/users/04db17e6f57945cd91da205ae04d86b4/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.177727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.179135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:04.188715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e7554316ac42488cbdc3f7e3b61148, user_id=04db17e6f57945cd91da205ae04d86b4, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.191417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e17925-1db2-44c4-a0e4-30642bc71823 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.192460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:04.204194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 997/1980] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:04 2022] PUT /identity/v3/projects/90e7554316ac42488cbdc3f7e3b61148/users/04db17e6f57945cd91da205ae04d86b4/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:04.215002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.215296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.215575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.241709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] MFA Rules not processed for user `04db17e6f57945cd91da205ae04d86b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:04.242933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:04.243310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c87a-11c1-482b-9971-abce18f2221d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.291852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.292511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.292797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.293076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.294892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:04.310190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 998/1981] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:04.311251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.356409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.357765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.367397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 984/1982] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:04.373680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99736c-5ae9-4fa7-a4d9-49e3f3d9fb1b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.378350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.379020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.379791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.380078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.380768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.382695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.409797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 999/1983] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:04 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:04.414436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.425727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f155f2-2204-4050-bd01-1b1812fdb046 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.485670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.486486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.486793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.487051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.487770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.489706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.517765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 985/1984] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:04 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:04.519326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.532065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361868b8-c0ae-4d6e-8a99-f5489edfa1ab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.537549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.538208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.538424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.538704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.539438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.541080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.551837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1000/1985] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:04.556109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.566042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410dd2a-9064-4561-bdab-e5bc1a7ef022 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.571326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.572207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.572559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.572838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] PATH_INFO: `/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d/users/f43bf06f4de24bb7a35415974ccaa814/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.575146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:04.590863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6d74dc864a49d4b5cec2f0f52dff0d, user_id=f43bf06f4de24bb7a35415974ccaa814, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.593541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.607136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 986/1986] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:04 2022] PUT /identity/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d/users/f43bf06f4de24bb7a35415974ccaa814/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:04.611117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.621118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d289-c058-4bbf-a377-36074f35a8be admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.633248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:04.683402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.684095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.684538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.684637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.685365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.687320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2aa20-d20c-4848-ac10-6c0770722162 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.701192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1001/1987] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:04.702451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.713390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c5c2-4484-4695-86d6-83184ce6780f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.718057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.719108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.719394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.719671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] PATH_INFO: `/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d/users/f43bf06f4de24bb7a35415974ccaa814/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.721662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6d74dc864a49d4b5cec2f0f52dff0d, user_id=f43bf06f4de24bb7a35415974ccaa814, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.724358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.740790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 987/1988] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:04 2022] PUT /identity/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d/users/f43bf06f4de24bb7a35415974ccaa814/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:04.751184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.751491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.751765 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.779548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] MFA Rules not processed for user `f43bf06f4de24bb7a35415974ccaa814`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:04.780760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:04.854540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1002/1989] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:04.866141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:04.867947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:04.926692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2c12-9d43-4a5d-9daa-414a8fc4e48d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:04.930377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:04.931024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:04.931317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:04.931582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:04.941136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:04.943202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:04.952949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 988/1990] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:05.036381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:05.049503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a47d5-be4b-4f3b-b026-ec1c0e344a42 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:05.055906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:05.055906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:05.056245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:05.056404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:05.140930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:05.143166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065168f9-786c-4d9f-9709-b6ca4efef8e9 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:05.155686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1003/1991] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:07.231601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:07.233064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:07.296553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc9e3a-0a2d-4ede-be80-634fea2a3e90 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:07.301672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:07.302581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:07.302870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:07.303153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] PATH_INFO: `/v3/users/33e9bce9aa4f485087fb8f564b37058e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:07.304342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e9bce9aa4f485087fb8f564b37058e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:07.306285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:07.350789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e9bce9aa4f485087fb8f564b37058e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:07.357751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e9bce9aa4f485087fb8f564b37058e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:07.358370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e9bce9aa4f485087fb8f564b37058e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:07.365517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e9bce9aa4f485087fb8f564b37058e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:07.372886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:07.377637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e9bce9aa4f485087fb8f564b37058e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:07.385277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 989/1992] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:07 2022] DELETE /identity/v3/users/33e9bce9aa4f485087fb8f564b37058e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:07.389706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:07.390186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:07.390279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:07.407142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:07.408329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:07.444959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:07.477542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1004/1993] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:07.486862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:07.488370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:07.547621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c19bc4-e018-427d-bb98-5b76008c55c3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:07.552118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:07.552768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:07.553047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:07.553323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:07.563527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:07.564953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:07.574963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 990/1994] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:07.976956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:07.978751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:08.006528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259922-ad53-4217-8c66-f3974c924e3b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:08.018401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:08.019420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:08.020654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:08.020925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] PATH_INFO: `/v3/projects/51cd0c3a761c44d4be8a4490584e71f8` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:08.023072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cd0c3a761c44d4be8a4490584e71f8)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:08.036165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:08.104095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cd0c3a761c44d4be8a4490584e71f8', 'request_id': 'req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:08.116106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cd0c3a761c44d4be8a4490584e71f8', 'request_id': 'req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:08.123068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cd0c3a761c44d4be8a4490584e71f8', 'request_id': 'req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:08.136063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] The token cache is being invalidate because project 51cd0c3a761c44d4be8a4490584e71f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:08.136474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:08.137199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65f8f38c-40bb-4a9b-ab01-2d11194b54ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:08.142195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1005/1995] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:07 2022] DELETE /identity/v3/projects/51cd0c3a761c44d4be8a4490584e71f8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:58:12.385161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:12.386651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:12.399979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab94b-aae2-4ab1-9660-abf04ac40c3c service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:12.454100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:12.454982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:12.455263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:12.455538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] PATH_INFO: `/v3/users/04db17e6f57945cd91da205ae04d86b4` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:12.456703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04db17e6f57945cd91da205ae04d86b4)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:12.459138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:12.503672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04db17e6f57945cd91da205ae04d86b4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:12.510418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04db17e6f57945cd91da205ae04d86b4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:12.511086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04db17e6f57945cd91da205ae04d86b4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:12.518256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04db17e6f57945cd91da205ae04d86b4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:12.530875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04db17e6f57945cd91da205ae04d86b4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:12.537243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 991/1996] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:12 2022] DELETE /identity/v3/users/04db17e6f57945cd91da205ae04d86b4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:12.541722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:12.542206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:12.542317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:12.559547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:12.560725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:12.617637 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1006/1997] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:12.627334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:12.628790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:12.643549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:12.691200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4fb5-c338-47a0-8de3-ee27ab77eba7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:12.695308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:12.695955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:12.696234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:12.696505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:12.705857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:12.707866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:12.717498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 992/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:13.005910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.007542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:13.022170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114b0d-160a-4e2a-bdc7-65d87021899e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.028980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.029942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.030293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.030571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] PATH_INFO: `/v3/projects/90e7554316ac42488cbdc3f7e3b61148` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.031774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e7554316ac42488cbdc3f7e3b61148)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.033672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.083367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e7554316ac42488cbdc3f7e3b61148', 'request_id': 'req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.087073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:13.091181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e7554316ac42488cbdc3f7e3b61148', 'request_id': 'req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.102335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e7554316ac42488cbdc3f7e3b61148', 'request_id': 'req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.113480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] The token cache is being invalidate because project 90e7554316ac42488cbdc3f7e3b61148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:13.114238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.114431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.115970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1007/1999] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:13 2022] DELETE /identity/v3/projects/90e7554316ac42488cbdc3f7e3b61148 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:13.120362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.130800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dcee9-c9ea-4f40-8a68-14af920ff730 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.187667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.188670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.188960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.189260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] PATH_INFO: `/v3/users/f43bf06f4de24bb7a35415974ccaa814` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.190485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43bf06f4de24bb7a35415974ccaa814)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.192408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.236137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43bf06f4de24bb7a35415974ccaa814'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.242610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43bf06f4de24bb7a35415974ccaa814'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.243217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43bf06f4de24bb7a35415974ccaa814'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.249786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43bf06f4de24bb7a35415974ccaa814'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.262260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8820a5f0-3fa8-4957-a205-974a09ba751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43bf06f4de24bb7a35415974ccaa814'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.268292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 993/2000] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:13 2022] DELETE /identity/v3/users/f43bf06f4de24bb7a35415974ccaa814 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:13.545631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.547101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:13.560837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eee33-7d6e-4772-ada5-e7dca2c4108d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.616906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.617781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.618070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.618394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] PATH_INFO: `/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.619613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6d74dc864a49d4b5cec2f0f52dff0d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.621506 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.668361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6d74dc864a49d4b5cec2f0f52dff0d', 'request_id': 'req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.675390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6d74dc864a49d4b5cec2f0f52dff0d', 'request_id': 'req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.682393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6d74dc864a49d4b5cec2f0f52dff0d', 'request_id': 'req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.692827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] The token cache is being invalidate because project ee6d74dc864a49d4b5cec2f0f52dff0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:13.693108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.693736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ab0cc09-65c4-4b31-b9c8-04e8a3abc315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:13.695526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1008/2001] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:13 2022] DELETE /identity/v3/projects/ee6d74dc864a49d4b5cec2f0f52dff0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:13.700075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.700550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.700640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.717999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:13.719275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:13.748832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:13.780185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 994/2002] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:13.788302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.788599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.788884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.806818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:13.808018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:13.816523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1009/2003] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:13.820533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.830395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db21f7-d4c6-440e-a140-00b7e10ee91a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.835767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.836430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.836710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.836984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.837710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:13.838020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.839639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.851781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 995/2004] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:13.856028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.865937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399726b-fb57-4411-85e1-c87fe72d8096 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.870680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.871326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.871606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.871879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.872569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.874465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.899616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1010/2005] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:13 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:13.903649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:13.913528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b05597-b60a-4c95-b923-1bfab71272a0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:13.974314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:13.974994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:13.975279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:13.975556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:13.976238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:13.978165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:13.998847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 996/2006] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:13 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:14.002957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.013861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ff65d-2e21-4cd1-bea8-57b369fd34ba admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.018986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.019739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.020023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.020336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.021048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.022636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.038726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1011/2007] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:14.042723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.053059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ffb1-977b-433c-8be2-88c16d32942a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.058090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.059243 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.059747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.060263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.061630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.064706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6015fd-5596-4790-be2e-08c653268754 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.076704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 997/2008] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:14.081437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.092394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407a4f-7844-4171-97c8-5be42e35508e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.097331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.098325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.098612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.098890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] PATH_INFO: `/v3/projects/2881665f7e594b22bf5b099f77719cd8/users/f4135650d0534918975d1599610ebef2/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.115908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2881665f7e594b22bf5b099f77719cd8, user_id=f4135650d0534918975d1599610ebef2, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.119168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.136714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1012/2009] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:14 2022] PUT /identity/v3/projects/2881665f7e594b22bf5b099f77719cd8/users/f4135650d0534918975d1599610ebef2/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:14.147576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.147868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.148199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.178264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] MFA Rules not processed for user `f4135650d0534918975d1599610ebef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:14.179562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:14.255325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 998/2010] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:14.259907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.270677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:14.326181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe2a14-cadc-47ca-b12c-7fbd2c388552 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.330969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.331636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.331922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.332849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.333594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.335523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.359864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1013/2011] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:14 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:14.364178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.374917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b99556-7af4-4e4b-a033-addc1ddcbaa9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.403898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:14.432724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.433430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.433720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.434002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.434727 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.436708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.456888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 999/2012] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:14 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:14.462306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.474977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5d89d-3e0c-4583-bff3-5a2dc252075c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.479553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.480208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.480503 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.480766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.481480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.483071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.493784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1014/2013] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:14.497778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.508663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b059708-5c5f-430b-a364-f08ee224e461 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.513387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.514257 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.514538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.514811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] PATH_INFO: `/v3/projects/13ac08dec12e48d19d1338f81a06bcb0/users/16551eed2f07444ea63e3e74b884cba6/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.532153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ac08dec12e48d19d1338f81a06bcb0, user_id=16551eed2f07444ea63e3e74b884cba6, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.534925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.547793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1000/2014] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:14 2022] PUT /identity/v3/projects/13ac08dec12e48d19d1338f81a06bcb0/users/16551eed2f07444ea63e3e74b884cba6/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:14.552516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.562904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fb51-7314-4899-a671-e8a05f8ead8a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.619976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.620737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.621081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.621361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.622082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.623685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511ea3-8aa9-4fee-bdc2-d2859511b543 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.634002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1015/2015] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:14.638535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.649256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d54a3-eaa7-47f4-8255-d2fbcc2328be admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.654050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.655056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.655403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.655773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] PATH_INFO: `/v3/projects/13ac08dec12e48d19d1338f81a06bcb0/users/16551eed2f07444ea63e3e74b884cba6/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.657980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ac08dec12e48d19d1338f81a06bcb0, user_id=16551eed2f07444ea63e3e74b884cba6, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.660737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.671347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1001/2016] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:14 2022] PUT /identity/v3/projects/13ac08dec12e48d19d1338f81a06bcb0/users/16551eed2f07444ea63e3e74b884cba6/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:14.683106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.683406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.683692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.711431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] MFA Rules not processed for user `16551eed2f07444ea63e3e74b884cba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:14.712556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:14.780219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1016/2017] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:14.791590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.793306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:14.852623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee9e1-2367-4bc6-bd71-32309c549d9d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.856368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.857022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.857309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.857582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:14.867112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:14.868563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:14.877981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1002/2018] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:14.946269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:14.952077 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:14.956400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97348c83-98d1-4940-adf8-09f1303ccfc2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:14.961774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:14.962513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:14.962868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:14.963192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:15.020488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:15.021923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e2c03-5b37-4820-b869-8cbf8eb17d3f service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:15.031220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1017/2019] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:17.717248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:17.780472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973987dd-5e08-4f55-b008-f6927ca166d2 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:17.785204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:17.786071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:17.786379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:17.786650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] PATH_INFO: `/v3/users/f4135650d0534918975d1599610ebef2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:17.787875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4135650d0534918975d1599610ebef2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:17.789793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:17.820653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:17.840936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4135650d0534918975d1599610ebef2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:17.848499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4135650d0534918975d1599610ebef2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:17.849117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4135650d0534918975d1599610ebef2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:17.856065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4135650d0534918975d1599610ebef2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:17.868155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4135650d0534918975d1599610ebef2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:17.874029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1003/2020] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:17 2022] DELETE /identity/v3/users/f4135650d0534918975d1599610ebef2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:17.878583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:17.879602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:17.879732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:17.896969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:17.898236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:17.959125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1018/2021] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:17.969092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:17.970567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:18.034158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bae0c-41ee-4a89-b66e-749886b48de6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:18.038361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:18.039013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:18.039294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:18.039571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:18.050314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:18.052074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:18.063292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1004/2022] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:18.334343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:18.335854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:18.348161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcf56d-824c-4947-9c82-33400f41bb72 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:18.352729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:18.353931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:18.354263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:18.354518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] PATH_INFO: `/v3/projects/2881665f7e594b22bf5b099f77719cd8` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:18.355710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2881665f7e594b22bf5b099f77719cd8)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:18.357712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:18.403991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2881665f7e594b22bf5b099f77719cd8', 'request_id': 'req-ff832e93-db8e-4c02-a489-8d486b91b72c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.410599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2881665f7e594b22bf5b099f77719cd8', 'request_id': 'req-ff832e93-db8e-4c02-a489-8d486b91b72c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.416710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2881665f7e594b22bf5b099f77719cd8', 'request_id': 'req-ff832e93-db8e-4c02-a489-8d486b91b72c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.427844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] The token cache is being invalidate because project 2881665f7e594b22bf5b099f77719cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:18.428132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.428795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.430603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1019/2023] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:18 2022] DELETE /identity/v3/projects/2881665f7e594b22bf5b099f77719cd8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:18.434345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:18.444469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eca40-220b-4b3c-8d3b-6dacdf716f2f service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:18.499276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:18.500145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:18.500427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:18.500700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] PATH_INFO: `/v3/users/16551eed2f07444ea63e3e74b884cba6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:18.501891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16551eed2f07444ea63e3e74b884cba6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:18.503859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:18.549583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16551eed2f07444ea63e3e74b884cba6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.552696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:18.557912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16551eed2f07444ea63e3e74b884cba6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.558627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16551eed2f07444ea63e3e74b884cba6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.567877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16551eed2f07444ea63e3e74b884cba6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.579725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95cc309e-4367-4ef1-bbd0-a51e0accce7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16551eed2f07444ea63e3e74b884cba6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.585598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1005/2024] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:18 2022] DELETE /identity/v3/users/16551eed2f07444ea63e3e74b884cba6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:18.845799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:18.847277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:18.861296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832e93-db8e-4c02-a489-8d486b91b72c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:18.886852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:18.920064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:18.920937 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:18.921222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:18.921499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] PATH_INFO: `/v3/projects/13ac08dec12e48d19d1338f81a06bcb0` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:18.922717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ac08dec12e48d19d1338f81a06bcb0)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:18.924653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:18.970779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ac08dec12e48d19d1338f81a06bcb0', 'request_id': 'req-1bb16135-57da-43d0-907c-4a3d103ef40e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.979578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ac08dec12e48d19d1338f81a06bcb0', 'request_id': 'req-1bb16135-57da-43d0-907c-4a3d103ef40e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.985852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ac08dec12e48d19d1338f81a06bcb0', 'request_id': 'req-1bb16135-57da-43d0-907c-4a3d103ef40e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.996742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] The token cache is being invalidate because project 13ac08dec12e48d19d1338f81a06bcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:18.997026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.997650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1bb16135-57da-43d0-907c-4a3d103ef40e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:18.999251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1020/2025] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:18 2022] DELETE /identity/v3/projects/13ac08dec12e48d19d1338f81a06bcb0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:19.004141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.004591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.004683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.023036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:19.024501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:19.084711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1006/2026] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:19.091786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.092084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.092369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.111186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:19.112414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:19.121057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1021/2027] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:19.125548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.135582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83606e4e-4615-41d4-9152-ba572d8bb8d4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.140260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.140929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.141231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.141512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.142309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:19.142624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.144245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.156853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1007/2028] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:19.161606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.170914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdd7c2-48fc-43f8-a8f7-f91b034b4948 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.175720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.176382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.176666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.176939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.178781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.180712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.212983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1022/2029] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:19.217471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.229822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440ea5-fd24-4760-8d14-a2534c0019cd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.293102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.293986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.294412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.294793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.295609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.298408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.335574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.342068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1008/2030] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:19.348828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575812-c221-4a75-aee4-7a8a926c2cad admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.357284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.358197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.358603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.358990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.359828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.361656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.380623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1023/2031] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:19.384616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.395126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422576f-8017-4090-a4e2-e068c5a11e75 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.400121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.400789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.401079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.401362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.402090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.403726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22064b-ea96-497f-8c4d-c65fc4607aea admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.414655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1009/2032] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:19.418806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.429027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e03c-062a-4b1d-8854-099c62b1f8bb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.434150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.435222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.435593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.435927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] PATH_INFO: `/v3/projects/2d1483ccc64c4c9fa790de5a71a62358/users/cca819335876456da82f5af6e53750ef/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.452132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1483ccc64c4c9fa790de5a71a62358, user_id=cca819335876456da82f5af6e53750ef, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.454943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.469473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1024/2033] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:19 2022] PUT /identity/v3/projects/2d1483ccc64c4c9fa790de5a71a62358/users/cca819335876456da82f5af6e53750ef/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:19.480053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.480289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.480577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.506369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] MFA Rules not processed for user `cca819335876456da82f5af6e53750ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:19.507606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:19.528233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:19.573112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1010/2034] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:19.577728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.633436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:19.646217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617967b-4ec3-447b-acf8-afae131f2e92 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.651342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.651999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.652283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.652562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.653262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.655246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.680089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1025/2035] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:19.684302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.695475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e30684-ca59-4638-87ba-bc5d9b5fa254 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.750415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.751019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.751303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.751581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.752261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.754811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.774186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1011/2036] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:19.778106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.788159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ebd6-c304-4c77-a247-f02599ef5d93 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.792732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.793382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.793667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.793944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.794705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.796272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.807104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1026/2037] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:19.810846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.821671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c9f4-2062-493a-b8a2-5de094e58a9b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.826319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.827232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.827518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.827805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] PATH_INFO: `/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f/users/790b55d0cfd340d4a5c592e9fdad9813/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.843949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2613b6e8aeb344ed88be73d6c0607c2f, user_id=790b55d0cfd340d4a5c592e9fdad9813, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.846683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.859695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1012/2038] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:19 2022] PUT /identity/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f/users/790b55d0cfd340d4a5c592e9fdad9813/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:19.864182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.874183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e22b5-191e-4fd3-97da-bd83f79d64e4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.931776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.932436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.932720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.933000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.933721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.935333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c5f8f-903c-4d4c-8ca1-fa36099dfcae admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.945970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1027/2039] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:19.950200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:19.960261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f2571-c753-4ce5-8fee-24e3b86f1030 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:19.965954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:19.966933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.967291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.967651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] PATH_INFO: `/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f/users/790b55d0cfd340d4a5c592e9fdad9813/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:19.969655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2613b6e8aeb344ed88be73d6c0607c2f, user_id=790b55d0cfd340d4a5c592e9fdad9813, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:19.972331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:19.982710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1013/2040] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:19 2022] PUT /identity/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f/users/790b55d0cfd340d4a5c592e9fdad9813/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:19.994303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:19.994622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:19.994901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:20.020801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] MFA Rules not processed for user `790b55d0cfd340d4a5c592e9fdad9813`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:20.021990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:20.087786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1028/2041] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:20.098938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:20.100681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:20.156678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eed12e-bdfe-4a6d-8e90-7e0c3083862f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:20.160842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:20.161491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:20.161775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:20.162050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:20.170833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:20.172260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99b471-cb08-4d4d-8f66-9c7a0be68a34 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:20.182195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1014/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:21.515914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:21.569800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:21.587140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3b05-d1e8-432b-8686-515c0353bbfe None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:21.591658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:21.592546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:21.592831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:21.593107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] PATH_INFO: `/v3/users/cca819335876456da82f5af6e53750ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:21.594329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca819335876456da82f5af6e53750ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:21.596257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:21.642941 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca819335876456da82f5af6e53750ef'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:21.651084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca819335876456da82f5af6e53750ef'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:21.651845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca819335876456da82f5af6e53750ef'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:21.659570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca819335876456da82f5af6e53750ef'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:21.672494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca819335876456da82f5af6e53750ef'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:21.679386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1029/2043] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:21 2022] DELETE /identity/v3/users/cca819335876456da82f5af6e53750ef => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:21.683792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:21.684287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:21.684389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:21.701597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:21.702815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:21.714215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:21.761259 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1015/2044] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:21.770781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:21.772194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:21.828422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cfaf3-4c86-4d8c-a8c5-0f5c34b6c90b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:21.832014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:21.832712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:21.832994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:21.833272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:21.843913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:21.845325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:21.855498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1030/2045] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:22.126596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:22.128488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:22.148049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842979-34b1-47f7-8c1d-3a42bb9c991f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:22.153780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:22.154687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.155000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.155322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] PATH_INFO: `/v3/projects/2d1483ccc64c4c9fa790de5a71a62358` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.156692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1483ccc64c4c9fa790de5a71a62358)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:22.158726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:22.210742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1483ccc64c4c9fa790de5a71a62358', 'request_id': 'req-eb70516d-e27c-420c-a7d9-6e81c5ae798e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.219393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1483ccc64c4c9fa790de5a71a62358', 'request_id': 'req-eb70516d-e27c-420c-a7d9-6e81c5ae798e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.235889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1483ccc64c4c9fa790de5a71a62358', 'request_id': 'req-eb70516d-e27c-420c-a7d9-6e81c5ae798e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.246904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] The token cache is being invalidate because project 2d1483ccc64c4c9fa790de5a71a62358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:22.247189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.247837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.249472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1016/2046] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:22 2022] DELETE /identity/v3/projects/2d1483ccc64c4c9fa790de5a71a62358 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:22.253398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:22.263156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3b09-1382-4c6e-88e6-54ab5acf3b02 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:22.320492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:22.321353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.321632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.321907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] PATH_INFO: `/v3/users/790b55d0cfd340d4a5c592e9fdad9813` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.323164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=790b55d0cfd340d4a5c592e9fdad9813)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:22.325129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:22.338352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:22.372789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790b55d0cfd340d4a5c592e9fdad9813'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.381115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790b55d0cfd340d4a5c592e9fdad9813'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.381828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790b55d0cfd340d4a5c592e9fdad9813'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.388689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790b55d0cfd340d4a5c592e9fdad9813'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.403115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-96efeae6-1a21-456c-a974-b1e3bae26f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790b55d0cfd340d4a5c592e9fdad9813'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.409284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1031/2047] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:22 2022] DELETE /identity/v3/users/790b55d0cfd340d4a5c592e9fdad9813 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:22.672067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:22.673624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:22.686949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70516d-e27c-420c-a7d9-6e81c5ae798e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:22.746636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:22.748130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.748416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.748692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] PATH_INFO: `/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.749895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2613b6e8aeb344ed88be73d6c0607c2f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:22.751977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:22.795387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:22.801328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2613b6e8aeb344ed88be73d6c0607c2f', 'request_id': 'req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.809564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2613b6e8aeb344ed88be73d6c0607c2f', 'request_id': 'req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.815831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2613b6e8aeb344ed88be73d6c0607c2f', 'request_id': 'req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.827949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] The token cache is being invalidate because project 2613b6e8aeb344ed88be73d6c0607c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:22.828235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.828885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5b71dfef-82dc-4c5e-a435-8e7c306f4f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:22.830701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1017/2048] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:22 2022] DELETE /identity/v3/projects/2613b6e8aeb344ed88be73d6c0607c2f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:22.836020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.836523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.836630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.856521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:22.857726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:22.917030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1032/2049] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:22.924685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.924981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.925266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.945336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:22.946619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:22.955194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1018/2050] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:22.959955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:22.969878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1f28-12ef-4175-a846-1c8c607d7232 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:22.975162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:22.975809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.976095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.976373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.977104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:22.977412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:22.979093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:22.990486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1033/2051] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:22.994735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.003857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ae5f-b4e2-488e-b31f-54caac2f534f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.008545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.009194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.009481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.009763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.010489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.012384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.037946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1019/2052] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:22 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:23.041875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.051658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44735-3ee1-46e8-99f9-a4c8424f58cc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.105936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.106564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.106854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.107152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.107849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.109760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.130444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1034/2053] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:23 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:23.134647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.145620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5e68-6bc6-4613-8aa8-b7add850a3ea admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.150558 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.151224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.151513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.151790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.152515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.154095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.164293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1020/2054] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:23.168127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.177826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbe71-17dc-49b7-a3fc-77240f3cb1c5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.182430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.183083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.183368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.183647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.184393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.185944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d24d1-9b4d-4d68-8339-d4c33f01d224 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.187225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:23.198687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1035/2055] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:23.202412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.212948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e9d2-feb7-490b-8caa-318c54a6b6fd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.217579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.218493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.218779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.219057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] PATH_INFO: `/v3/projects/7a39707890ea4bd8b51aa32b3aa1a942/users/0f1f358c94544a6c8662bfc1184175a5/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.233164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a39707890ea4bd8b51aa32b3aa1a942, user_id=0f1f358c94544a6c8662bfc1184175a5, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.235840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.250381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1021/2056] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:23 2022] PUT /identity/v3/projects/7a39707890ea4bd8b51aa32b3aa1a942/users/0f1f358c94544a6c8662bfc1184175a5/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:23.263673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.263897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.264173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.290955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] MFA Rules not processed for user `0f1f358c94544a6c8662bfc1184175a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:23.292273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:23.359082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1036/2057] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:23.363359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.424801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d67c-8ebe-4043-bfdd-27a4e3e77fd6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.429490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.430313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.430693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.431147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.431841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.433736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.461408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1022/2058] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:23 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:23.465671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.476781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213199a0-8d3f-4510-90f0-81d4015deff5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.535493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.536177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.536467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.536748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.537471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.539421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.563342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1037/2059] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:23 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:23.564790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.575900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deea7e-7c44-4af3-9ab2-fac16d2a6f42 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.580554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.581230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.581517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.581846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.582604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.584203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.594930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1023/2060] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:23.598982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.609174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84306f-9427-467d-8cb1-d0284f17f17a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.614378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.615252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.615539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.615818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] PATH_INFO: `/v3/projects/26b50807872e487badc323906ca6d81b/users/674d005896704b48b5fa97e2159f9e0c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.631138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b50807872e487badc323906ca6d81b, user_id=674d005896704b48b5fa97e2159f9e0c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.633801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.647211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1038/2061] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:23 2022] PUT /identity/v3/projects/26b50807872e487badc323906ca6d81b/users/674d005896704b48b5fa97e2159f9e0c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:23.651385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.663094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70f828-ac16-46de-ad14-c00a2adda082 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.704298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:23.721363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.722045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.722378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.722646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.723374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.724965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54247acb-c22d-4348-8926-75d4779073cd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.734846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1024/2062] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:23.739448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.749907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93025ad6-6f60-499b-8552-81e754615e49 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:23.755260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:23.756163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.756448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.756727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] PATH_INFO: `/v3/projects/26b50807872e487badc323906ca6d81b/users/674d005896704b48b5fa97e2159f9e0c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.758759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b50807872e487badc323906ca6d81b, user_id=674d005896704b48b5fa97e2159f9e0c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.761377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.771898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1039/2063] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:23 2022] PUT /identity/v3/projects/26b50807872e487badc323906ca6d81b/users/674d005896704b48b5fa97e2159f9e0c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:23.782602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:23.782900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:23.783186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:23.811104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] MFA Rules not processed for user `674d005896704b48b5fa97e2159f9e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:23.812355 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:23.898760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1025/2064] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:23.907195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:23.909173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:23.978008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:23.999735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20397-95c7-4299-aadd-32bb488c293c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.004208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.005032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.005323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.005602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.016480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.017960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b40f7-1edc-4470-a01c-d0d56a6f7f5f service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.030273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1040/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:24.068336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.112251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e3b9-bb25-4abb-92aa-795994bd241c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.112251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e3b9-bb25-4abb-92aa-795994bd241c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.112251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e3b9-bb25-4abb-92aa-795994bd241c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.112251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1041/2066] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 08:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:58:24.134607 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375cf3-b4cc-4108-a7e4-a5f0ab69d207 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.139549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.140517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.140876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.141226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] PATH_INFO: `/v3/users/0f1f358c94544a6c8662bfc1184175a5` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.142569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1f358c94544a6c8662bfc1184175a5)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.145268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.151960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cc73-158b-4788-8ba7-c2f36943b413 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.152337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cc73-158b-4788-8ba7-c2f36943b413 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.152802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9cc73-158b-4788-8ba7-c2f36943b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.175147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2da9cc73-158b-4788-8ba7-c2f36943b413 None None] MFA Rules not processed for user `4169e5c77cc24a36ba0c3955b7637afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:24.176812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2da9cc73-158b-4788-8ba7-c2f36943b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.202601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1f358c94544a6c8662bfc1184175a5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.226302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1f358c94544a6c8662bfc1184175a5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.227474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1f358c94544a6c8662bfc1184175a5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.236647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1f358c94544a6c8662bfc1184175a5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.240491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.256325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1f358c94544a6c8662bfc1184175a5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.259344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1042/2067] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 08:58:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:24.262795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1026/2068] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:24 2022] DELETE /identity/v3/users/0f1f358c94544a6c8662bfc1184175a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:24.267643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.267741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.268008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.272971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.274885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.287462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:24.288653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.354697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae456d-e2c4-4c37-8d2f-713c293f377f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.360196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.360610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1043/2069] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:24.364658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.364959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.365245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.371565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.374039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.374746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.376338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.387061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1027/2070] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:24.441965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ccd04-062e-4999-87fb-d1f629cd8ef3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.447733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.448395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.448679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.448955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.461478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.462936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.472550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1044/2071] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:24.748384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.750531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.751758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.753892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.765664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c673-deb0-4533-ad51-8d1461443646 service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.775673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.775854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faceaf-d61f-487c-b269-9667ea3d4726 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.776891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.777176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.777456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] PATH_INFO: `/v3/users/1c758cb7b97a4a63aa7ddd5d2561ec37` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.778830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c758cb7b97a4a63aa7ddd5d2561ec37)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.780659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.782353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.783210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.783583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.783757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] PATH_INFO: `/v3/projects/7a39707890ea4bd8b51aa32b3aa1a942` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.785520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a39707890ea4bd8b51aa32b3aa1a942)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:24.787417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:24.804499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:24.830255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c758cb7b97a4a63aa7ddd5d2561ec37'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.837509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a39707890ea4bd8b51aa32b3aa1a942', 'request_id': 'req-1cd419be-dd8a-4810-9b64-af5e41c87b88'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.840276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c758cb7b97a4a63aa7ddd5d2561ec37'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.840912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c758cb7b97a4a63aa7ddd5d2561ec37'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.844623 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a39707890ea4bd8b51aa32b3aa1a942', 'request_id': 'req-1cd419be-dd8a-4810-9b64-af5e41c87b88'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.848972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c758cb7b97a4a63aa7ddd5d2561ec37'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.851674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a39707890ea4bd8b51aa32b3aa1a942', 'request_id': 'req-1cd419be-dd8a-4810-9b64-af5e41c87b88'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.860904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c758cb7b97a4a63aa7ddd5d2561ec37'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.862435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] The token cache is being invalidate because project 7a39707890ea4bd8b51aa32b3aa1a942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:24.862722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.863963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:24.865577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1045/2072] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:24 2022] DELETE /identity/v3/projects/7a39707890ea4bd8b51aa32b3aa1a942 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:24.869420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:24.870582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1028/2073] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:24 2022] DELETE /identity/v3/users/1c758cb7b97a4a63aa7ddd5d2561ec37 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:24.871007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:24.936118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd419be-dd8a-4810-9b64-af5e41c87b88 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:24.995440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:24.996326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:24.996608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:24.996883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] PATH_INFO: `/v3/users/674d005896704b48b5fa97e2159f9e0c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:24.998088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=674d005896704b48b5fa97e2159f9e0c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.000109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.042763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.045615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.052299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674d005896704b48b5fa97e2159f9e0c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.056217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:25.063226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674d005896704b48b5fa97e2159f9e0c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.064258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674d005896704b48b5fa97e2159f9e0c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.065221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124460-b26c-4158-bfee-191624ea7e62 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.073017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.073926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.074239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.074523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] PATH_INFO: `/v3/projects/b1f80e4cf23f42f1ab7cbb6113bfbf3f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.074622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674d005896704b48b5fa97e2159f9e0c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.075721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f80e4cf23f42f1ab7cbb6113bfbf3f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.077751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.088975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674d005896704b48b5fa97e2159f9e0c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.101638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1046/2074] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:24 2022] DELETE /identity/v3/users/674d005896704b48b5fa97e2159f9e0c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:58:25.131455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:25.145137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f80e4cf23f42f1ab7cbb6113bfbf3f', 'request_id': 'req-36062bd8-41f4-441e-86c3-ead96aabf89a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.153173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f80e4cf23f42f1ab7cbb6113bfbf3f', 'request_id': 'req-36062bd8-41f4-441e-86c3-ead96aabf89a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.159045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f80e4cf23f42f1ab7cbb6113bfbf3f', 'request_id': 'req-36062bd8-41f4-441e-86c3-ead96aabf89a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.170756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] The token cache is being invalidate because project b1f80e4cf23f42f1ab7cbb6113bfbf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:25.170980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.171633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.173190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1029/2075] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:25 2022] DELETE /identity/v3/projects/b1f80e4cf23f42f1ab7cbb6113bfbf3f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:25.177212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.178695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.247608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a74b0-c664-46be-8b79-f88d9c4b6c2a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.313436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.314365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.314650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.314927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] PATH_INFO: `/v3/users/aca0b27136034bb9bf0896d2d6632865` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.316156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca0b27136034bb9bf0896d2d6632865)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.318266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.369394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca0b27136034bb9bf0896d2d6632865'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.377969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca0b27136034bb9bf0896d2d6632865'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.379156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca0b27136034bb9bf0896d2d6632865'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.386614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca0b27136034bb9bf0896d2d6632865'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.399148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:25.400749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca0b27136034bb9bf0896d2d6632865'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.408676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1047/2076] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:25 2022] DELETE /identity/v3/users/aca0b27136034bb9bf0896d2d6632865 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:25.467670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.469373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.492084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062bd8-41f4-441e-86c3-ead96aabf89a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.563652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.564544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.564827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.565273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] PATH_INFO: `/v3/projects/26b50807872e487badc323906ca6d81b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.567576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b50807872e487badc323906ca6d81b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.569485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.607283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.608929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.620162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b50807872e487badc323906ca6d81b', 'request_id': 'req-7b4be179-12ae-48a1-bbd2-2800b3590cb5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.628448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b50807872e487badc323906ca6d81b', 'request_id': 'req-7b4be179-12ae-48a1-bbd2-2800b3590cb5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.634521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d77890-56de-49e5-97bc-e96bc46e9318 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.637724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b50807872e487badc323906ca6d81b', 'request_id': 'req-7b4be179-12ae-48a1-bbd2-2800b3590cb5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.650434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] The token cache is being invalidate because project 26b50807872e487badc323906ca6d81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:25.650726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.651380 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7b4be179-12ae-48a1-bbd2-2800b3590cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.652984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1030/2077] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:25 2022] DELETE /identity/v3/projects/26b50807872e487badc323906ca6d81b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:25.657599 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a482-0038-4980-9fef-0e9d505702e0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.657885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a482-0038-4980-9fef-0e9d505702e0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.658182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a482-0038-4980-9fef-0e9d505702e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.675748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c0e6a482-0038-4980-9fef-0e9d505702e0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:25.676959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c0e6a482-0038-4980-9fef-0e9d505702e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.698459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.699323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.699603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.699872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] PATH_INFO: `/v3/projects/01d88d4faca84007929507471480ff86` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.701054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d88d4faca84007929507471480ff86)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.703061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.730578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:25.742350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1031/2078] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:25.749824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.750438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.750438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.753185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d88d4faca84007929507471480ff86', 'request_id': 'req-cb997260-c337-4d2f-8791-9f4ccf1e85de'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.762381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d88d4faca84007929507471480ff86', 'request_id': 'req-cb997260-c337-4d2f-8791-9f4ccf1e85de'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.769038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d88d4faca84007929507471480ff86', 'request_id': 'req-cb997260-c337-4d2f-8791-9f4ccf1e85de'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.770383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:25.771645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.780263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] The token cache is being invalidate because project 01d88d4faca84007929507471480ff86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:25.780557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.781200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb997260-c337-4d2f-8791-9f4ccf1e85de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:25.782784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1048/2079] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:25 2022] DELETE /identity/v3/projects/01d88d4faca84007929507471480ff86 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:25.787621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1200b-e3f2-4217-bc67-72738e5263e4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.787910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1200b-e3f2-4217-bc67-72738e5263e4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.788182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1200b-e3f2-4217-bc67-72738e5263e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.806478 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-23a1200b-e3f2-4217-bc67-72738e5263e4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:25.807673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23a1200b-e3f2-4217-bc67-72738e5263e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.831565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1032/2080] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:25.835504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.844473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eccf7-3502-4aa8-9c5c-f06030e7b057 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.849519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.850247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.850534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.850818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.851542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:25.851851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.853463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.865422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1033/2081] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:58:25.870627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.871610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1049/2082] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:25.880091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.880372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.880654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.881126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386ec6-9a4f-4b23-be85-344c7a988bfc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.885915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.886918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.887208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.887484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.888157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.890066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.899939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:25.901524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:25.911235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1050/2083] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:25.915602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.925003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83917cbe-558e-44a2-9860-bc36460e5b33 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.925290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1034/2084] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:25.929946 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:25.942772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:25.982381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:25.982957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:25.983233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:25.983508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:25.984228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:25.984533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:25.986136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:25.994577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967516-b929-447f-8058-3b888afcbfcc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:25.997892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1051/2085] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:58:25.999738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.000626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.000908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.001271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.002011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.002164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.004627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.012536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935841e5-b31a-4ccb-8f03-5ac4a56deaf6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.017775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.018556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.018854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.019306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.019993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.021882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.024681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1035/2086] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:25 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:26.028551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.037955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa672a2-79cc-4ddc-9860-481e3f42175b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.043444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.044086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.044365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.044637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.045356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.046959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.053897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1052/2087] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:26.055117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.061216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1036/2088] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.062195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.072161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fedcdd-3257-48e9-9b06-550d6e830a59 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.117497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:26.127771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c9ff3-cb09-48b8-826b-44bbf67ee0f9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.133035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.133732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.134053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.134368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.135064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.136398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.137089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.137372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.137468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.137648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.138414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.142138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.157573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1037/2089] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.161270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1053/2090] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:26.162200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.163714 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.172418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970fae5-b524-4a23-8f82-70b49a3bda5f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.174472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83567385-536b-46f4-b0a1-c631ecd8a864 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.177720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.178993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.179287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.179568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] PATH_INFO: `/v3/projects/f5992e9294a04b29b1dd544096722002/users/d1aba9deae4e4b7ba6d5758ae1de11d9/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.179664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.180216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.180501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.180803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.181521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.183140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.193178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1054/2091] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.194579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5992e9294a04b29b1dd544096722002, user_id=d1aba9deae4e4b7ba6d5758ae1de11d9, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.197143 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.197679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e0620-03fa-4abb-a249-10b86c16af31 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.207580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6bb6-7883-4836-a718-7c4537f2ef7f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.211213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1038/2092] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:26 2022] PUT /identity/v3/projects/f5992e9294a04b29b1dd544096722002/users/d1aba9deae4e4b7ba6d5758ae1de11d9/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:58:26.223394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.223678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.224036 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.250215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] MFA Rules not processed for user `d1aba9deae4e4b7ba6d5758ae1de11d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:26.251383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:26.265086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.265766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.266126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.266417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.267164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.268760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.278959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1055/2093] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.282968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.292750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caddfa3-426d-4e53-9475-3bc6ac031af3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.297348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.298264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.298547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.298825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] PATH_INFO: `/v3/projects/fcf72f967ca14cda843668b675cd1c18/users/a4da7c608e7c4656a6feb510302e693f/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.301652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:26.316781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf72f967ca14cda843668b675cd1c18, user_id=a4da7c608e7c4656a6feb510302e693f, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.319388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e211b7e-af23-46ea-956b-7f878eb9f3c7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.321174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1039/2094] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:26.325443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.338565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc91f-2ff0-4cd2-800c-a20bc93a78d2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.339676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1056/2095] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:26 2022] PUT /identity/v3/projects/fcf72f967ca14cda843668b675cd1c18/users/a4da7c608e7c4656a6feb510302e693f/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:58:26.350519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.350818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.351103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.378963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] MFA Rules not processed for user `a4da7c608e7c4656a6feb510302e693f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:26.380185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:26.399992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.400756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.401116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.401464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.402251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.404561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.436231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1040/2096] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:26.438046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.454201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1057/2097] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:26.458985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.472830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:26.474037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64129d6f-8243-405c-86e2-864df230dd77 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.514518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fc86d-25e0-4ea8-afe5-03dadf3ed6af admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.520996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.521679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.521965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.522281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.522975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.525176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.538560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.539322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.539638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.540047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.540838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.542933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.553335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1041/2098] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/users => generated 307 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:26.554970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.569877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad405e-f33a-4bbc-a73b-c6e612d9af83 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.574997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1058/2099] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:26.575398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.576140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.576503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.576863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.577660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.579125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.579905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.598000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1042/2100] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:26.599057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.610743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bc06-83bf-4f80-92dc-06c4e84b855c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.654020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:26.657983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd8ab8-25a2-4aa5-bb65-0ed8493aad04 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.665378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.666061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.666377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.666658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.667732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.670351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.683897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.684963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.685247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.685530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] PATH_INFO: `/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7/users/24c34122aa4d462da6a16ce5752fa76d/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.695355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1059/2101] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:26.699264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.706253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7427f250a9d4fdd93fc7c90ecc817e7, user_id=24c34122aa4d462da6a16ce5752fa76d, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.709274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc645-03a7-45fc-b0d6-f60a591cb9bd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.709948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.713917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.714654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.714945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.715384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.715952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.717535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.727359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1043/2102] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:26 2022] PUT /identity/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7/users/24c34122aa4d462da6a16ce5752fa76d/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:26.731116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1060/2103] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.734460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.735575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.746618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdafcc3-0a2c-43a4-bf38-973c38bcce70 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.805693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbaf0-1c74-4ba6-ae6d-40e061000407 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.811057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.812493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.812782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.813061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.813676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.813957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.814615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.814908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.815189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] PATH_INFO: `/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37/users/5bafed86bd2d4fd6b91d55d48e41dc75/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.816506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.827160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1044/2104] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:26.831062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.835291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f1a28ec99e4264b5e2029f33fcea37, user_id=5bafed86bd2d4fd6b91d55d48e41dc75, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.839050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.845310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbacdc-8726-4f2e-9696-aeacd0cd3da5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:26.851169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:26.852232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.852528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.853344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] PATH_INFO: `/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7/users/24c34122aa4d462da6a16ce5752fa76d/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.855632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1061/2105] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:26 2022] PUT /identity/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37/users/5bafed86bd2d4fd6b91d55d48e41dc75/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:26.858197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7427f250a9d4fdd93fc7c90ecc817e7, user_id=24c34122aa4d462da6a16ce5752fa76d, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:26.859778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:26.859907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81124-2ca4-4796-9f33-cc6d5a0aae44 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:26.871453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1045/2106] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:26 2022] PUT /identity/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7/users/24c34122aa4d462da6a16ce5752fa76d/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:26.882156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:26.882455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:26.882782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:26.917068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:26.920158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] MFA Rules not processed for user `24c34122aa4d462da6a16ce5752fa76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:26.921500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:26.935386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ebbd2-a8a8-4938-89eb-8f7ef9e2c654 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:27.004400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:27.005165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.006008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.006376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.007182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:27.008866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:27.017452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1046/2107] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:27.022157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1062/2108] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:27.026382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:27.029218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:27.031027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:27.037741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d817-774e-4b48-810b-5e0b4bc32481 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:27.038474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:27.043291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:27.044205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.044497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.044782 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] PATH_INFO: `/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37/users/5bafed86bd2d4fd6b91d55d48e41dc75/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.047047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f1a28ec99e4264b5e2029f33fcea37, user_id=5bafed86bd2d4fd6b91d55d48e41dc75, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:27.049788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007ecd5-2365-47ec-9da9-acea0553de7d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:27.061219 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1047/2109] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:27 2022] PUT /identity/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37/users/5bafed86bd2d4fd6b91d55d48e41dc75/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:58:27.071633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.071904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.072183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.097097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aea0d-71f5-48c4-8f4c-83c23386c783 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:27.098711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] MFA Rules not processed for user `5bafed86bd2d4fd6b91d55d48e41dc75`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:27.099961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:27.156984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:27.157755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.158060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.158367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.169761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1048/2110] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:27.180899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:27.182279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:27.194163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1e73c-c97e-4fc5-a64c-9ab6b0eb2bd2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:27.198620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:27.199263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.199546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.199821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.224431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:27.225867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:27.246679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1063/2111] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:27.259895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:27.261332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:27.270388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1049/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:58:27.310324 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:27.319231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58142-0eb2-4029-820c-37b322ca0424 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:27.322972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:27.323618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:27.323905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:27.324183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:27.382847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:27.384280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:27.393222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1064/2113] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:31.479789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:31.488924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6c57d-e068-41da-ac73-eb1d9064a931 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:31.491996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:31.492628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:31.492910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:31.493188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:31.500384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:31.503067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:31.505326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dab5b3-7c83-46b7-91a5-5d5820040f08 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:31.515642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1050/2114] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:31.632849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:31.641366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:31.700384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c5ed9-2a93-4adc-a1a6-bac1e5a1e647 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:31.705243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:31.706175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:31.706546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:31.707321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] PATH_INFO: `/v3/users/d1aba9deae4e4b7ba6d5758ae1de11d9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:31.708759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1aba9deae4e4b7ba6d5758ae1de11d9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:31.710693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:31.760386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1aba9deae4e4b7ba6d5758ae1de11d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:31.770183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1aba9deae4e4b7ba6d5758ae1de11d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:31.770983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1aba9deae4e4b7ba6d5758ae1de11d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:31.783465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1aba9deae4e4b7ba6d5758ae1de11d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:31.797264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1aba9deae4e4b7ba6d5758ae1de11d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:31.806254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1065/2115] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:31 2022] DELETE /identity/v3/users/d1aba9deae4e4b7ba6d5758ae1de11d9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:31.811139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:31.811792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:31.811986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:31.840543 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:31.843521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:31.910253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1051/2116] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:31.917776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:31.919238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:31.978124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9219c50-990b-4b6d-90a1-f2db30109488 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:31.981797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:31.982475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:31.982767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:31.983045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:31.992611 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:31.994034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:32.004081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1066/2117] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:32.265226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:32.266689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:32.279323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466841-a43c-4efd-a9e9-e97ba313cfc3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:32.284037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:32.286370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:32.286724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:32.287094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] PATH_INFO: `/v3/projects/f5992e9294a04b29b1dd544096722002` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:32.288458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5992e9294a04b29b1dd544096722002)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:32.290812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:32.336518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5992e9294a04b29b1dd544096722002', 'request_id': 'req-188501f1-a111-4f86-9205-cd13b36c7b4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.343908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5992e9294a04b29b1dd544096722002', 'request_id': 'req-188501f1-a111-4f86-9205-cd13b36c7b4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.350083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5992e9294a04b29b1dd544096722002', 'request_id': 'req-188501f1-a111-4f86-9205-cd13b36c7b4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.360858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] The token cache is being invalidate because project f5992e9294a04b29b1dd544096722002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:32.361143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.361797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.364011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1052/2118] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:32 2022] DELETE /identity/v3/projects/f5992e9294a04b29b1dd544096722002 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:32.368059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:32.377647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30204b6-3ab5-4442-b036-27203a7acbc9 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:32.403541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:32.435363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:32.436163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:32.436449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:32.436722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] PATH_INFO: `/v3/users/24c34122aa4d462da6a16ce5752fa76d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:32.437906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c34122aa4d462da6a16ce5752fa76d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:32.439896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:32.484681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c34122aa4d462da6a16ce5752fa76d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.492555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c34122aa4d462da6a16ce5752fa76d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.493197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c34122aa4d462da6a16ce5752fa76d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.500109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c34122aa4d462da6a16ce5752fa76d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.511670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-989c4472-20f8-4bce-82dd-3e3cbb035d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c34122aa4d462da6a16ce5752fa76d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.517502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1067/2119] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:32 2022] DELETE /identity/v3/users/24c34122aa4d462da6a16ce5752fa76d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:32.781813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:32.783500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:32.797977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188501f1-a111-4f86-9205-cd13b36c7b4d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:32.856501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:32.857370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:32.857654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:32.857930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] PATH_INFO: `/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:32.859176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7427f250a9d4fdd93fc7c90ecc817e7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:32.861106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:32.885586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:32.911739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7427f250a9d4fdd93fc7c90ecc817e7', 'request_id': 'req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.918871 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7427f250a9d4fdd93fc7c90ecc817e7', 'request_id': 'req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.924239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7427f250a9d4fdd93fc7c90ecc817e7', 'request_id': 'req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.935264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] The token cache is being invalidate because project a7427f250a9d4fdd93fc7c90ecc817e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:32.935625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.936275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-25bea7c6-1824-4fd4-a455-ad3be1afd1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:32.942476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1053/2120] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:32 2022] DELETE /identity/v3/projects/a7427f250a9d4fdd93fc7c90ecc817e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:32.945270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:32.945740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:32.945874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:32.971618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:32.972931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.059425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1068/2121] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:33.068351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.068588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.068940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.095503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:33.096989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.113162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1054/2122] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:33.117363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.127722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b64f3b-b7d8-4f56-9cb0-28c7cb3463b0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.132935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.133599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.133880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.134181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.134911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:33.135216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.136801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.150163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1069/2123] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:33.154690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.173356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0fefc-f005-4a2a-8794-68f77351e964 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.173356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.173356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.173356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.173716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.173716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.174701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.200301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1055/2124] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:33 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:33.204683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.215464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d577-ad65-4a78-98d2-69b8b6a1f74a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.249368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:33.276968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.277659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.277958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.278271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.279000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.280945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.300525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1070/2125] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:33 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:33.304840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.315296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac372cfd-fdbb-4783-98ce-7271648739be admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.320231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.320875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.321152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.321423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.322251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.323944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.335077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1056/2126] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:33.338953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.350053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3902c-163e-43b9-8a75-61f451eed8f8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.354970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.355629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.355917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.356247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.356959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.358598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a98a2-4659-41f7-8724-b131348951e4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.369030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1071/2127] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:33.373333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.383505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935b27e-0bd3-4f54-a0ce-9637fb3d05e3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.388114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.388997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.389283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.389560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] PATH_INFO: `/v3/projects/6855566f2f62400c9bff806cc4cee875/users/ae0ae7283cd84affbce219596ef2c4c2/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.404497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6855566f2f62400c9bff806cc4cee875, user_id=ae0ae7283cd84affbce219596ef2c4c2, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.407177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.420234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1057/2128] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:33 2022] PUT /identity/v3/projects/6855566f2f62400c9bff806cc4cee875/users/ae0ae7283cd84affbce219596ef2c4c2/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:33.431182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.431475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.431754 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.458794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] MFA Rules not processed for user `ae0ae7283cd84affbce219596ef2c4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:33.459984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.521115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1072/2129] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:33.532363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.534070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.589090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30cf-c020-4bd1-82ca-daed0e8cd706 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.592689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.593325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.593602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.593874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.602534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.603948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1fa0-d150-411f-953e-a033ecb7533b service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.612548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1058/2130] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:33.632494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.693084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5c57-1d80-4e6f-b4ee-4c03d0d3b184 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.697758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.698668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.698955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.699235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] PATH_INFO: `/v3/users/ae0ae7283cd84affbce219596ef2c4c2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.700441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0ae7283cd84affbce219596ef2c4c2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.702558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.746036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:33.747530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0ae7283cd84affbce219596ef2c4c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:33.756097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0ae7283cd84affbce219596ef2c4c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:33.757055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0ae7283cd84affbce219596ef2c4c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:33.763829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0ae7283cd84affbce219596ef2c4c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:33.776265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0ae7283cd84affbce219596ef2c4c2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:33.782202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1073/2131] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:33 2022] DELETE /identity/v3/users/ae0ae7283cd84affbce219596ef2c4c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:33.786720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.787197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.787301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.804143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:33.805323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.850554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:33.866866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1059/2132] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:33.876382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:33.877849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:33.936298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b6e7-1af5-44e7-8355-7043247b9034 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:33.939884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:33.940525 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:33.941323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:33.941601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:33.950423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:33.952179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaea57-a4a3-493c-8575-fe6b0bf30ab5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:33.962699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1074/2133] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:34.293759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.296262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:34.310996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd756e-bdf3-4fa9-b12e-dfd5692b87a4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.323716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.324542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.324835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.325114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] PATH_INFO: `/v3/projects/6855566f2f62400c9bff806cc4cee875` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.334420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6855566f2f62400c9bff806cc4cee875)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.336425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.383805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6855566f2f62400c9bff806cc4cee875', 'request_id': 'req-3a07104f-6004-4dac-9c42-6b2998b254f9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:34.390819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6855566f2f62400c9bff806cc4cee875', 'request_id': 'req-3a07104f-6004-4dac-9c42-6b2998b254f9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:34.397077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6855566f2f62400c9bff806cc4cee875', 'request_id': 'req-3a07104f-6004-4dac-9c42-6b2998b254f9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:34.409675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] The token cache is being invalidate because project 6855566f2f62400c9bff806cc4cee875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:34.409994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:34.410809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3a07104f-6004-4dac-9c42-6b2998b254f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:34.412770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1060/2134] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:34 2022] DELETE /identity/v3/projects/6855566f2f62400c9bff806cc4cee875 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:34.418017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.418323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.418603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.436001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:34.437209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:34.497827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1075/2135] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:34.506002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.506331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.506618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.525652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:34.526890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:34.535097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1061/2136] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:34.539294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.548851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b0b7-5146-499c-ba4d-74a3b8a211e1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.553581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.554265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.554549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.554845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.555592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:34.555922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.557657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.570086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1076/2137] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:58:34.574300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.584223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e5419-827a-4ae6-bb98-902072defa93 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.588846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.589524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.589807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.590085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.590803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.592740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.616869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1062/2138] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:34 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:34.620967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.631194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4014e6-8966-4f03-aee9-efeae247bf46 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.678224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:34.689194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.690007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.690332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.690660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.692010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.693907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.714403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1077/2139] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:34 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:34.718486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.728749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c063b-896c-488d-b69a-c9d0198944d5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.733332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.733986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.734309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.734588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.735305 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.736907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.747598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1063/2140] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:34.751493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.761882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fd53-d736-465a-ad01-cea8a44b4b53 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.766625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.767308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.767620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.767900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.768629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.770310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe7ab9-c6f1-4f28-a873-4b0d2e024bfa admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.780442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1078/2141] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:34.784446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.794072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4e7f-5c85-46c4-ba4b-b2987bd89f79 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.798691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.799556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.799834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.800583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] PATH_INFO: `/v3/projects/9ac03ee9f83d40c59435cbfbdd189338/users/1d045efdc421474b9da55688be0ea24b/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.814401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac03ee9f83d40c59435cbfbdd189338, user_id=1d045efdc421474b9da55688be0ea24b, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.817613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:34.830184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1064/2142] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:34 2022] PUT /identity/v3/projects/9ac03ee9f83d40c59435cbfbdd189338/users/1d045efdc421474b9da55688be0ea24b/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:34.835160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.835458 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.835742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.853375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:34.854599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:34.912749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1079/2143] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:34.922251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:34.923936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:34.980436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00922-758d-4bb7-a797-3e2fe1120b5b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:34.984232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:34.984864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:34.985148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:34.985426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:34.995126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:34.996549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116f425-2562-4a5f-8727-3e7056cd1194 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:35.006745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1065/2144] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:36.482644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:36.484193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:36.499242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c879-4bdc-43dc-9a09-3848866d9928 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:36.504775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:36.506616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:36.507606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:36.508001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] PATH_INFO: `/v3/users/a4da7c608e7c4656a6feb510302e693f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:36.509419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4da7c608e7c4656a6feb510302e693f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:36.512823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:36.571374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4da7c608e7c4656a6feb510302e693f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:36.580228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4da7c608e7c4656a6feb510302e693f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:36.580865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4da7c608e7c4656a6feb510302e693f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:36.589508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4da7c608e7c4656a6feb510302e693f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:36.602706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4da7c608e7c4656a6feb510302e693f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:36.620647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1080/2145] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:36 2022] DELETE /identity/v3/users/a4da7c608e7c4656a6feb510302e693f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:36.631232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:36.631694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:36.631774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:36.664684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:36.665904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:36.671868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:36.765369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1066/2146] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:36.782308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:36.783769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:36.849913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:36.861604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b3a0f-83bc-4973-a47b-c7a7f7f0691b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:36.866278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:36.867000 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:36.867302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:36.868059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:36.879832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:36.881264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:36.891164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1081/2147] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:37.203124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:37.204732 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:37.221316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038a5a1-3014-4215-9926-75f6fe97bb61 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:37.233054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:37.233884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:37.234375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:37.234656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] PATH_INFO: `/v3/projects/fcf72f967ca14cda843668b675cd1c18` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:37.236003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf72f967ca14cda843668b675cd1c18)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:37.237982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:37.323623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf72f967ca14cda843668b675cd1c18', 'request_id': 'req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.337750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf72f967ca14cda843668b675cd1c18', 'request_id': 'req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.348145 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf72f967ca14cda843668b675cd1c18', 'request_id': 'req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.362832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] The token cache is being invalidate because project fcf72f967ca14cda843668b675cd1c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:37.363124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.363807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.365398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1067/2148] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:37 2022] DELETE /identity/v3/projects/fcf72f967ca14cda843668b675cd1c18 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:37.369406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:37.383190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e79f1-586d-4dfd-8c26-56b7bf96c5a3 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:37.450950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:37.451881 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:37.452462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:37.452751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] PATH_INFO: `/v3/users/5bafed86bd2d4fd6b91d55d48e41dc75` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:37.454084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bafed86bd2d4fd6b91d55d48e41dc75)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:37.456070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:37.514243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bafed86bd2d4fd6b91d55d48e41dc75'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.526023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bafed86bd2d4fd6b91d55d48e41dc75'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.527138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bafed86bd2d4fd6b91d55d48e41dc75'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.539539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bafed86bd2d4fd6b91d55d48e41dc75'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.558180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e4f596ca-fa9f-4507-b4a2-1048d5aa3bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bafed86bd2d4fd6b91d55d48e41dc75'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:37.570564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1082/2149] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:37 2022] DELETE /identity/v3/users/5bafed86bd2d4fd6b91d55d48e41dc75 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:38.172527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.174657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:38.196809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a9fc-cbe6-47e1-95f7-75ad3f8804af admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.274553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.275435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.275723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.276005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] PATH_INFO: `/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.277421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f1a28ec99e4264b5e2029f33fcea37)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.281139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.338535 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:38.357952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f1a28ec99e4264b5e2029f33fcea37', 'request_id': 'req-33fb00a8-70dc-45aa-aef2-09381afeffa0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:38.369642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f1a28ec99e4264b5e2029f33fcea37', 'request_id': 'req-33fb00a8-70dc-45aa-aef2-09381afeffa0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:38.382321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f1a28ec99e4264b5e2029f33fcea37', 'request_id': 'req-33fb00a8-70dc-45aa-aef2-09381afeffa0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:38.413547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] The token cache is being invalidate because project c4f1a28ec99e4264b5e2029f33fcea37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:38.413935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:38.414523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-33fb00a8-70dc-45aa-aef2-09381afeffa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:38.421450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1068/2150] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:38 2022] DELETE /identity/v3/projects/c4f1a28ec99e4264b5e2029f33fcea37 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:38.423011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.423468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.423916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.453310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:38.457566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:38.561839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1083/2151] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:38.573123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.573455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.573699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.599389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:38.600678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:38.611357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1069/2152] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:38.616290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.630807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff09f-ef8d-41c9-b719-124b09492286 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.635903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.636873 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.637003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.637226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.637921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:38.638263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.639880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.641730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:38.660726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1084/2153] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:38.665006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.674882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe31eb-16c5-4833-931c-69e877d579b3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.681008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.681783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.682162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.682519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.683280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.685256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.719672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1070/2154] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:38 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:38.724759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.735711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610eae4-f736-4be4-929e-7871d08319cc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.809750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.810660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.811227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.811659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.812498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.814684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.844029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1085/2155] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:38 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:58:38.848785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.859416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec135a90-d672-4464-8c05-30ab10bf5945 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.864578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.865248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.865524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.865920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.866687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.868309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.884892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1071/2156] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:38.888820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.899934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6891820-440f-40ff-944c-764423b57cd0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.908944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.910909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.911410 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.912139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.913092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.915095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e923d1b-b5ab-4313-ab84-e416612057b8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.929246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1086/2157] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:38.933355 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:38.943349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d18e2-f477-4fa0-a5b5-517027dfc425 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:38.948610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:38.949509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:38.949790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:38.950067 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] PATH_INFO: `/v3/projects/686336110aa04c03956937c6935c58d3/users/b775db9cf1a0470aa3a9fb7f0822fbfd/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:38.969207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686336110aa04c03956937c6935c58d3, user_id=b775db9cf1a0470aa3a9fb7f0822fbfd, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:38.972812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:38.990821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1072/2158] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:38 2022] PUT /identity/v3/projects/686336110aa04c03956937c6935c58d3/users/b775db9cf1a0470aa3a9fb7f0822fbfd/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:39.002535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.002753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.003647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.058962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] MFA Rules not processed for user `b775db9cf1a0470aa3a9fb7f0822fbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:39.060325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:39.170736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1087/2159] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:39.171903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.266190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec13d1-3c9f-4ef9-848a-bbc39234edb5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.279542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.280375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.280546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.280818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.281514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.284546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.321463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1073/2160] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:39 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:39.323565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.336760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37bcf-c36a-4cf5-8f53-ffc6c1f03bf6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.420824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.421679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.421981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.422298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.423013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.426470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.437024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:39.463166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1088/2161] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:39 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:39.465070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.484070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a0b66-38c3-470f-a201-5a07a2ca2694 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.489723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.490785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.491142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.491548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.492362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.494088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.511847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1074/2162] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:39.517709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.538138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c40d6-ebd6-4278-aa8d-ae26283aa351 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.583916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.585566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.586333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.586760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] PATH_INFO: `/v3/projects/1812af4e668047f18cffd695e69f387e/users/82dd6892a7f34b59af8dd11b0f74ba6e/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.604157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1812af4e668047f18cffd695e69f387e, user_id=82dd6892a7f34b59af8dd11b0f74ba6e, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.612455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.636918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1089/2163] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:39 2022] PUT /identity/v3/projects/1812af4e668047f18cffd695e69f387e/users/82dd6892a7f34b59af8dd11b0f74ba6e/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:39.641567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.655780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad281f-4c08-4729-8160-1089750a47e9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.697509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:39.730768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.731434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.731720 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.732000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.733337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.734984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8edbe-3cb3-48d2-895f-c3c3ec2b2210 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.748430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1075/2164] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:39.753260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.766456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5baf14-f923-4904-b3a3-c00e1834bb68 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:39.772043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:39.773838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.774232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.774586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] PATH_INFO: `/v3/projects/1812af4e668047f18cffd695e69f387e/users/82dd6892a7f34b59af8dd11b0f74ba6e/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.776778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1812af4e668047f18cffd695e69f387e, user_id=82dd6892a7f34b59af8dd11b0f74ba6e, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:39.779728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:39.796353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1090/2165] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:39 2022] PUT /identity/v3/projects/1812af4e668047f18cffd695e69f387e/users/82dd6892a7f34b59af8dd11b0f74ba6e/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:39.808093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037eeb6-bd36-421d-b90c-2e4d9cd3d47f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:39.808414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037eeb6-bd36-421d-b90c-2e4d9cd3d47f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:39.808605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037eeb6-bd36-421d-b90c-2e4d9cd3d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:39.841222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e037eeb6-bd36-421d-b90c-2e4d9cd3d47f None None] MFA Rules not processed for user `82dd6892a7f34b59af8dd11b0f74ba6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:39.842602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e037eeb6-bd36-421d-b90c-2e4d9cd3d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:39.928171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1076/2166] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:39.944443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:39.946362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:40.040201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87c3e-22d5-44f0-8891-0548f3b2ec0e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.043647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.044349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.044640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.044921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.138716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.140392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.154307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1091/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:40.208276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.208565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.208843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.242100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] MFA Rules not processed for user `1d045efdc421474b9da55688be0ea24b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:40.243350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:40.313814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1077/2168] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:40.318284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.320117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:40.395085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550e94-6dd5-47d4-ba2b-3e7046623492 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.400153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.400876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.401185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.401509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.402185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.404423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.418234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:40.431969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1092/2169] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:40 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:40.436186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.451963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56809-459b-47db-b4f4-76fd8e45f63a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.506639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:40.528793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.529482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.529738 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.530013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.530779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.532695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.552745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1078/2170] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:40 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:40.557068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.568732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290dd6e-8c38-4a89-8861-7f8f6275a504 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.573444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.574100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.574414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.574694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.575425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.577091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.588438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1093/2171] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:40.592602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.602951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97eac-cf47-4123-8638-d336c4e3bf6d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.607597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.608478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.608762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.609038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] PATH_INFO: `/v3/projects/bb2a71279fbd400ea35a3357b82b94e1/users/1b96912a051948be9066f2b09957942c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.624024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2a71279fbd400ea35a3357b82b94e1, user_id=1b96912a051948be9066f2b09957942c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.626714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.639905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1079/2172] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:40 2022] PUT /identity/v3/projects/bb2a71279fbd400ea35a3357b82b94e1/users/1b96912a051948be9066f2b09957942c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:40.644520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.655150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf0543-c175-4a75-b53a-02fa225136e7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.712752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.713598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.714081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.714442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.715199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.716868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.730770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1094/2173] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:58:40.734928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:40.747222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6db5d-e106-4289-b69c-d4916acab4a7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:40.752000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:40.752897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:40.753742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:40.754024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] PATH_INFO: `/v3/projects/bb2a71279fbd400ea35a3357b82b94e1/users/1b96912a051948be9066f2b09957942c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:40.756069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2a71279fbd400ea35a3357b82b94e1, user_id=1b96912a051948be9066f2b09957942c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:40.758937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90010c6f-f2a8-457c-8e7e-03dcd152f6f7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:40.770065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1080/2174] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:40 2022] PUT /identity/v3/projects/bb2a71279fbd400ea35a3357b82b94e1/users/1b96912a051948be9066f2b09957942c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:42.810923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:42.849155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99af86-be6a-44c3-96c1-b6af3395facf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:42.927610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:42.928569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:42.928858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:42.929178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] PATH_INFO: `/v3/users/b775db9cf1a0470aa3a9fb7f0822fbfd` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:42.930652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b775db9cf1a0470aa3a9fb7f0822fbfd)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:42.932805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:43.008699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b775db9cf1a0470aa3a9fb7f0822fbfd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:43.021711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b775db9cf1a0470aa3a9fb7f0822fbfd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:43.023406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b775db9cf1a0470aa3a9fb7f0822fbfd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:43.035838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b775db9cf1a0470aa3a9fb7f0822fbfd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:43.057239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b775db9cf1a0470aa3a9fb7f0822fbfd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:43.058024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:43.068575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1095/2175] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:42 2022] DELETE /identity/v3/users/b775db9cf1a0470aa3a9fb7f0822fbfd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:43.075721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:43.076202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:43.076295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:43.113420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:43.115241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:43.246565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1081/2176] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:43.257342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:43.265734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:43.423541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12d64c-e76c-4c33-bb52-87436ec7c5ee admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:43.433853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:43.434945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:43.437179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:43.437667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:43.450236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:43.452115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:43.467548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1096/2177] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:44.089428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:44.090937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:44.122613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb06c-a5fa-4828-8084-caa3ebc613f5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:44.138794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:44.139684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:44.140139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:44.140572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] PATH_INFO: `/v3/projects/686336110aa04c03956937c6935c58d3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:44.142058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] RBAC: Authorizing `identity:delete_project(project_id=686336110aa04c03956937c6935c58d3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:44.144770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:44.305597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686336110aa04c03956937c6935c58d3', 'request_id': 'req-4c596fdd-a17e-4d28-94af-f7089d0e006c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.318449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686336110aa04c03956937c6935c58d3', 'request_id': 'req-4c596fdd-a17e-4d28-94af-f7089d0e006c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.328274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686336110aa04c03956937c6935c58d3', 'request_id': 'req-4c596fdd-a17e-4d28-94af-f7089d0e006c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.346052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] The token cache is being invalidate because project 686336110aa04c03956937c6935c58d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:44.347735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.348801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.356558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:44.357076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1082/2178] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:44 2022] DELETE /identity/v3/projects/686336110aa04c03956937c6935c58d3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:44.367902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c3146-4634-4481-a43a-fa1ebfd2b42b service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:44.463501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:44.464627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:44.464917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:44.465338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] PATH_INFO: `/v3/users/82dd6892a7f34b59af8dd11b0f74ba6e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:44.466923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82dd6892a7f34b59af8dd11b0f74ba6e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:44.469030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:44.553204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82dd6892a7f34b59af8dd11b0f74ba6e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.565528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82dd6892a7f34b59af8dd11b0f74ba6e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.566556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82dd6892a7f34b59af8dd11b0f74ba6e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.576138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82dd6892a7f34b59af8dd11b0f74ba6e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.593626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f877a149-1a8f-4789-8713-a878e9df3bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82dd6892a7f34b59af8dd11b0f74ba6e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:44.606281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1097/2179] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:58:44 2022] DELETE /identity/v3/users/82dd6892a7f34b59af8dd11b0f74ba6e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:44.926524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:44.928842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:44.953780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c596fdd-a17e-4d28-94af-f7089d0e006c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:44.981420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:45.041977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.043015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.043420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.043692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] PATH_INFO: `/v3/projects/1812af4e668047f18cffd695e69f387e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.045584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1812af4e668047f18cffd695e69f387e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.048121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.133314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1812af4e668047f18cffd695e69f387e', 'request_id': 'req-01754839-77c2-4018-aea3-7d6c70c47289'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:45.147555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1812af4e668047f18cffd695e69f387e', 'request_id': 'req-01754839-77c2-4018-aea3-7d6c70c47289'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:45.159119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1812af4e668047f18cffd695e69f387e', 'request_id': 'req-01754839-77c2-4018-aea3-7d6c70c47289'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:45.173823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] The token cache is being invalidate because project 1812af4e668047f18cffd695e69f387e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:58:45.174138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:45.174854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-01754839-77c2-4018-aea3-7d6c70c47289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:58:45.180284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1083/2180] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:58:44 2022] DELETE /identity/v3/projects/1812af4e668047f18cffd695e69f387e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:45.182093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.182401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.182890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.203404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:45.205163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:45.221476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:45.282831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1098/2181] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:45.283848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.284179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.284461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.303944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:45.305183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:45.316934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1084/2182] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:45.318619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.329823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b65977-3c53-448e-92c0-d6a6503f6e6c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.335491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.336296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.336587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.336860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.337602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:58:45.337911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.339550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.360303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1099/2183] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:58:45.361789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.373044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a319-9240-4be5-8cd9-1bb49913c813 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.378716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.379506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.379858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.380147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.380845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.383077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.415027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1085/2184] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:58:45 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:45.417164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.430556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad57c-d486-4ee3-9ade-33615b8e2a41 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.520034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.520725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.521012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.521286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.522029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.524337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.561781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1100/2185] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:58:45 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:58:45.573756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.591526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ce13-62d9-4e03-9a1b-ec09cdbd6441 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.597632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.598830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.598830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.599124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.600051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.605822 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.636851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1086/2186] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:45.641016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.664424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b1dc-8ba3-4b7b-bc4b-e46a662ac06e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.676949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.677912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.678234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.678521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.679323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.681828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ed5f-4ab4-49b2-998d-aba1c509ba7e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.696096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1101/2187] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:58:45.701022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.718316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89439ce-a65e-40f4-8d3c-a64e0ea3e0b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:45.731880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:45.732968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.733314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.733660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] PATH_INFO: `/v3/projects/f0bd162f44ae426ba1f97f548b33a611/users/713a24b6e0884f9d90930d7118ddccfc/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.768481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bd162f44ae426ba1f97f548b33a611, user_id=713a24b6e0884f9d90930d7118ddccfc, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:45.771606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:45.802198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1087/2188] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:58:45 2022] PUT /identity/v3/projects/f0bd162f44ae426ba1f97f548b33a611/users/713a24b6e0884f9d90930d7118ddccfc/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:45.812814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61310e-2d54-4182-a349-d3bb51184e0d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:45.812933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61310e-2d54-4182-a349-d3bb51184e0d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:45.813213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61310e-2d54-4182-a349-d3bb51184e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:45.845625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ac61310e-2d54-4182-a349-d3bb51184e0d None None] MFA Rules not processed for user `713a24b6e0884f9d90930d7118ddccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:45.847921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ac61310e-2d54-4182-a349-d3bb51184e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:45.940350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1102/2189] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:58:45.948106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:45.950730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:46.045006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:46.053258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb88ba-5afb-41e4-b88a-8bd0a1ee8d33 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:46.058533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:46.059501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:46.060290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:46.061044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:46.074357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:46.076281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:46.100526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1088/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:46.914668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26732a-78c5-410a-b5e7-7adedffa2401 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:46.915175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26732a-78c5-410a-b5e7-7adedffa2401 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:46.915271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26732a-78c5-410a-b5e7-7adedffa2401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:46.944140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ae26732a-78c5-410a-b5e7-7adedffa2401 None None] MFA Rules not processed for user `1b96912a051948be9066f2b09957942c`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:46.945961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ae26732a-78c5-410a-b5e7-7adedffa2401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:46.950699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:47.069633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1103/2191] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:47.084778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:47.086346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:47.171448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73380f-6429-4862-b071-82ee6824f0ec service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:47.177576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:47.178369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:47.178994 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:47.179429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:47.182226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:47.271217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:47.273043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7b81-ab99-4524-8afd-4e248432df73 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:47.283693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1089/2192] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:58:47.469727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:47.470030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:47.470359 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:47.492064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:47.493316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:47.523141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91a4a-9c63-4826-8fed-f05e5058d9a6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:47.523431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91a4a-9c63-4826-8fed-f05e5058d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:47.523710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91a4a-9c63-4826-8fed-f05e5058d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:47.548942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c8f91a4a-9c63-4826-8fed-f05e5058d9a6 None None] MFA Rules not processed for user `cf0d83e0a9074cc580983ed20f6417c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:47.551207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8f91a4a-9c63-4826-8fed-f05e5058d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:47.609101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1104/2193] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:47.626998 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1090/2194] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:58:47.661488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:47.663248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:47.784620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cde1f-d903-48b0-ba9c-cf08c970965f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:47.798165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:47.799067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:47.799498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:47.800392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:47.813158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:47.816008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46414102-92ad-40f9-a362-a2bc1cf97518 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:47.826468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1105/2195] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 08:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:58:57.615808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=77 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:57.823033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:58:58.063557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:58.063852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:58.064135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:58.081746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] MFA Rules not processed for user `1d045efdc421474b9da55688be0ea24b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:58:58.083009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:58.089912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1091/2196] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:58:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:00.247601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:00.248081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:00.248162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:00.267604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:00.269121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:00.278166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1106/2197] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:00.292203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:00.305462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d1fe-c16a-4442-ad8b-460d7677e18a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:00.311286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:00.311949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:00.312256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:00.312534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:00.323690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:00.325364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300074bc-4ff9-4411-be0b-aed610499274 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:00.334853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1092/2198] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 08:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:59:00.347327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:00.423300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371197e-6bd9-4289-adf6-023ee64891b6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:00.428932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:00.429892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:00.430121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:00.430407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] PATH_INFO: `/v3/users/713a24b6e0884f9d90930d7118ddccfc` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:00.434629 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713a24b6e0884f9d90930d7118ddccfc)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:00.440144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:00.521389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713a24b6e0884f9d90930d7118ddccfc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:00.531857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713a24b6e0884f9d90930d7118ddccfc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:00.532696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713a24b6e0884f9d90930d7118ddccfc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:00.542252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713a24b6e0884f9d90930d7118ddccfc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:00.557293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713a24b6e0884f9d90930d7118ddccfc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:00.564762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1107/2199] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:59:00 2022] DELETE /identity/v3/users/713a24b6e0884f9d90930d7118ddccfc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:00.569269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:00.569940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:00.570471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:00.590967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:00.592754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:00.672467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1093/2200] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:00.683296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:00.684820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:00.742880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd279b0-0184-42ea-bb40-2a2dffc12441 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:00.746544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:00.747191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:00.747480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:00.747757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:00.756976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:00.758445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26ecf3-fb38-4747-94d6-a05a6676b4db service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:00.768212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1108/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:59:01.238344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.239894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:01.252044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b19b91-e392-4eff-a920-8cfb36c7f37d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.256666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.257595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.257880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.258194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] PATH_INFO: `/v3/projects/f0bd162f44ae426ba1f97f548b33a611` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.259379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bd162f44ae426ba1f97f548b33a611)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.261297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.309674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bd162f44ae426ba1f97f548b33a611', 'request_id': 'req-c3dc0f6f-c461-4376-a1e6-a198424c7a93'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:01.319425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bd162f44ae426ba1f97f548b33a611', 'request_id': 'req-c3dc0f6f-c461-4376-a1e6-a198424c7a93'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:01.327293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bd162f44ae426ba1f97f548b33a611', 'request_id': 'req-c3dc0f6f-c461-4376-a1e6-a198424c7a93'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:01.341844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] The token cache is being invalidate because project f0bd162f44ae426ba1f97f548b33a611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:59:01.342173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:01.342997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c3dc0f6f-c461-4376-a1e6-a198424c7a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:01.344588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1094/2202] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:59:01 2022] DELETE /identity/v3/projects/f0bd162f44ae426ba1f97f548b33a611 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:01.350332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.350782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.350901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.367974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:01.369166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:01.378864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:01.440968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1109/2203] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:01.442808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.443097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.443401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.462509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:01.463742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:01.471790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1095/2204] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:01.476035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.485940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556a5c-b497-4fa6-be00-e3bd548edacd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.490517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.491168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.491450 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.491728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.492452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:59:01.492758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.494362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.507252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1110/2205] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:59:01.511698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.524659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178623c-54ff-4d74-9b8f-26074037bef5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.531400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.532090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.532358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.532632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.533339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.535330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.560693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1096/2206] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:59:01.565251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.576429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f950c-c77e-4e67-936d-bbe59e70d211 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.655179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.655856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.656168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.656445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.657135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.659181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.678625 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1111/2207] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:01.682845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.693490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002319a-03a6-464f-b759-1881f322bc1a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.698465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.699133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.699418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.699697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.700425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.703052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.714439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1097/2208] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:01.718597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.729012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862155c-6620-4ff6-bed5-c082b1ab296e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.734209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.734908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.735198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.735479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.736216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.738333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc6af-47ae-4abc-82bb-c8c329fd86de admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.748694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1112/2209] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:59:01.753517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.764460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec30d8-6d6f-4493-9642-f9ac083c5b21 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.769104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.770022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.770344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.770623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] PATH_INFO: `/v3/projects/d4b2ddd3d0814d09a112e9574aab2b1b/users/ab8cc3c5635d49c5b90036726c512668/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.784985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b2ddd3d0814d09a112e9574aab2b1b, user_id=ab8cc3c5635d49c5b90036726c512668, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.787699 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:01.796119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:01.801820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1098/2210] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:59:01 2022] PUT /identity/v3/projects/d4b2ddd3d0814d09a112e9574aab2b1b/users/ab8cc3c5635d49c5b90036726c512668/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:01.812449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.812684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.812965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.840283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] MFA Rules not processed for user `ab8cc3c5635d49c5b90036726c512668`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:01.841606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:01.909252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1113/2211] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:01.913518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:01.979479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b9a1-2868-477d-b80c-9ec787e63504 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:01.984513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:01.985199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:01.985484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:01.985756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:01.986497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:01.989020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.019054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1099/2212] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:59:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:02.023395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.034016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3823d-d956-4ebd-8f3c-c4a386be67fb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.041592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:02.096833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.097666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.098055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.098460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.099261 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.101591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.142139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1114/2213] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:59:02 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:02.143550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.155333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048f092-1cf7-4811-8b2a-f993b31dd0e5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.166321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.167015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.167301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.167582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.168351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.169905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.181749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1100/2214] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:02.192241 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.201281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d752b-cb18-41f4-a4fb-246c55b91d0b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.208142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.209188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.209668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.210206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.211543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.213340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f31ed-b1a4-40c1-b763-206fb439d59e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.236306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1115/2215] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:02.236518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.240873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc31104-6503-41aa-b851-44b866cc3ad3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.247160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.248269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.248622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.249151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] PATH_INFO: `/v3/projects/394d07709f6a4756bd9d33489bb63b09/users/56e3ac16e0e1433da4ff3df6968c7a6d/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.264696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394d07709f6a4756bd9d33489bb63b09, user_id=56e3ac16e0e1433da4ff3df6968c7a6d, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.267939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.282007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1101/2216] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:59:02 2022] PUT /identity/v3/projects/394d07709f6a4756bd9d33489bb63b09/users/56e3ac16e0e1433da4ff3df6968c7a6d/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:59:02.293024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.293336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.293594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.324918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] MFA Rules not processed for user `56e3ac16e0e1433da4ff3df6968c7a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:02.326495 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:02.400493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1116/2217] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:02.404964 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.469349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8b49d-553e-468f-af16-901643c74aa0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.474620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.475296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.475641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.475921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.476754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.478979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.506300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1102/2218] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:02.510538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.521082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d985-5b5a-4163-bf02-e1c99abce275 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.576384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.576983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.577270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.577556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.578314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.580304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.603779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1117/2219] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:59:02 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:02.607997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.621110 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e53e-65bc-49df-8034-71c3eeefee99 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.626518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.627353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.628152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.628500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.629159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.630910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.641820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1103/2220] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:02.646260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.656383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b8dc-f899-4bc3-bb5d-f95c0b1f4763 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.660972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.661843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.662134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.662419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] PATH_INFO: `/v3/projects/8cc04b4859da40849e81b9a1585ae233/users/28eb9d1f3f0947df93a88a6745428a46/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.665409 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:02.679195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc04b4859da40849e81b9a1585ae233, user_id=28eb9d1f3f0947df93a88a6745428a46, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.681898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.697210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1118/2221] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:59:02 2022] PUT /identity/v3/projects/8cc04b4859da40849e81b9a1585ae233/users/28eb9d1f3f0947df93a88a6745428a46/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:02.701294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.712074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732912fc-23a4-466f-a952-f6194a1ba0d8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.736214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:02.774901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.775597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.775878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.776151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.776865 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.778495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca330298-e50e-4b9c-993a-8d6d59022507 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.787897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1104/2222] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:02.792191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:02.803229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a238e5-53c6-4a7e-94b5-a94834af23d0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:02.807913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:02.808806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.809115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.809397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] PATH_INFO: `/v3/projects/8cc04b4859da40849e81b9a1585ae233/users/28eb9d1f3f0947df93a88a6745428a46/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.811346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc04b4859da40849e81b9a1585ae233, user_id=28eb9d1f3f0947df93a88a6745428a46, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:02.813984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:02.826104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1119/2223] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:59:02 2022] PUT /identity/v3/projects/8cc04b4859da40849e81b9a1585ae233/users/28eb9d1f3f0947df93a88a6745428a46/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:02.893258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:02.893611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:02.893901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:02.919916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] MFA Rules not processed for user `28eb9d1f3f0947df93a88a6745428a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:02.921103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:02.994493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1105/2224] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:03.005996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:03.007758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:03.064543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6743e2-c945-495c-bf8c-a6f81d2599d3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:03.068381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:03.069036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:03.069318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:03.069594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:03.127594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:03.129037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:03.137891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1120/2225] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:04.700482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:04.702470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:04.715051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31351-1e6d-4c4c-b13c-59f066de3eae None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:04.718660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:04.719310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:04.719590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:04.719862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:04.802612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:04.804051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:04.813701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1106/2226] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:05.414744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:05.424089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426358d-52ae-4011-8741-6609c0d363fd service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:05.427986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:05.428689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:05.428977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:05.429284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:05.438411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:05.440337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c976e5-e9b2-40a3-8929-66722021f5d1 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:05.449751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1121/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:09.420403 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:09.476191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:09.505444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832004-677a-480a-817e-76c5f25a0903 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:09.510018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:09.511218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:09.511506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:09.511794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] PATH_INFO: `/v3/users/ab8cc3c5635d49c5b90036726c512668` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:09.513003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8cc3c5635d49c5b90036726c512668)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:09.516290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:09.570050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8cc3c5635d49c5b90036726c512668'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:09.579552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8cc3c5635d49c5b90036726c512668'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:09.580238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8cc3c5635d49c5b90036726c512668'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:09.592519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8cc3c5635d49c5b90036726c512668'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:09.614852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8cc3c5635d49c5b90036726c512668'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:09.638017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1107/2228] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:59:09 2022] DELETE /identity/v3/users/ab8cc3c5635d49c5b90036726c512668 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:09.639945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:09.640434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:09.640534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:09.657980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:09.659895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:09.721620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1122/2229] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:09.731320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:09.733089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:09.792401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed16c2-f484-4cde-bc05-6a231df166b1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:09.796022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:09.796673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:09.796955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:09.797228 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:09.806757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:09.808179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:09.818786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1108/2230] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:10.108134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:10.109622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:10.124627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cd179-e6a0-4981-b7bf-93f80ff4b8a2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:10.131034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:10.131622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:10.131908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:10.132185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] PATH_INFO: `/v3/projects/d4b2ddd3d0814d09a112e9574aab2b1b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:10.133412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b2ddd3d0814d09a112e9574aab2b1b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:10.135443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:10.146468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:10.194569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b2ddd3d0814d09a112e9574aab2b1b', 'request_id': 'req-1f74f987-d91e-4980-bb92-da1712304daf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.203067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b2ddd3d0814d09a112e9574aab2b1b', 'request_id': 'req-1f74f987-d91e-4980-bb92-da1712304daf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.210698 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b2ddd3d0814d09a112e9574aab2b1b', 'request_id': 'req-1f74f987-d91e-4980-bb92-da1712304daf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.230586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] The token cache is being invalidate because project d4b2ddd3d0814d09a112e9574aab2b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:59:10.231328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.232502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.234570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1123/2231] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:59:10 2022] DELETE /identity/v3/projects/d4b2ddd3d0814d09a112e9574aab2b1b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:10.238694 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:10.248830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baadd42-d9b1-4998-ad60-011c902b9852 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:10.307347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:10.308508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:10.308779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:10.309126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] PATH_INFO: `/v3/users/56e3ac16e0e1433da4ff3df6968c7a6d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:10.310463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e3ac16e0e1433da4ff3df6968c7a6d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:10.312521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:10.320198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:10.366517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e3ac16e0e1433da4ff3df6968c7a6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.373702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e3ac16e0e1433da4ff3df6968c7a6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.374448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e3ac16e0e1433da4ff3df6968c7a6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.381820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e3ac16e0e1433da4ff3df6968c7a6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.394269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e3ac16e0e1433da4ff3df6968c7a6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.400711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1109/2232] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:59:10 2022] DELETE /identity/v3/users/56e3ac16e0e1433da4ff3df6968c7a6d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:59:10.778790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:10.780272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:10.800144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74f987-d91e-4980-bb92-da1712304daf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:10.919444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:10.920526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:10.920962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:10.921389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] PATH_INFO: `/v3/projects/394d07709f6a4756bd9d33489bb63b09` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:10.923093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394d07709f6a4756bd9d33489bb63b09)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:10.925683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:10.981038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394d07709f6a4756bd9d33489bb63b09', 'request_id': 'req-b650b412-a0f0-4371-9490-8a90efe6ba39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.990352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394d07709f6a4756bd9d33489bb63b09', 'request_id': 'req-b650b412-a0f0-4371-9490-8a90efe6ba39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:10.997830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394d07709f6a4756bd9d33489bb63b09', 'request_id': 'req-b650b412-a0f0-4371-9490-8a90efe6ba39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.010041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] The token cache is being invalidate because project 394d07709f6a4756bd9d33489bb63b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:59:11.010362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.011025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.012591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1124/2233] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:59:10 2022] DELETE /identity/v3/projects/394d07709f6a4756bd9d33489bb63b09 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:11.016709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:11.018679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:11.031646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb93a3-bacf-4adf-a0dd-c5a6117a9a7e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:11.100726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:11.101620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.101931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.102238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] PATH_INFO: `/v3/users/28eb9d1f3f0947df93a88a6745428a46` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.103442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eb9d1f3f0947df93a88a6745428a46)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:11.105367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:11.177127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eb9d1f3f0947df93a88a6745428a46'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.186948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eb9d1f3f0947df93a88a6745428a46'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.187673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eb9d1f3f0947df93a88a6745428a46'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.195478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eb9d1f3f0947df93a88a6745428a46'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.207829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6564c62a-2c41-4e47-92b4-053c6170ca12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eb9d1f3f0947df93a88a6745428a46'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.213664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1110/2234] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:59:11 2022] DELETE /identity/v3/users/28eb9d1f3f0947df93a88a6745428a46 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:11.503120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:11.504584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:11.518016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b412-a0f0-4371-9490-8a90efe6ba39 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:11.563817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:11.607690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:11.608667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.609024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.609373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] PATH_INFO: `/v3/projects/8cc04b4859da40849e81b9a1585ae233` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.610665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc04b4859da40849e81b9a1585ae233)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:11.613175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:11.679099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc04b4859da40849e81b9a1585ae233', 'request_id': 'req-feb81b51-d5f2-4306-993d-4ec9dabf6755'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.686884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc04b4859da40849e81b9a1585ae233', 'request_id': 'req-feb81b51-d5f2-4306-993d-4ec9dabf6755'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.694352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc04b4859da40849e81b9a1585ae233', 'request_id': 'req-feb81b51-d5f2-4306-993d-4ec9dabf6755'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.705507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] The token cache is being invalidate because project 8cc04b4859da40849e81b9a1585ae233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:59:11.705878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.706654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-feb81b51-d5f2-4306-993d-4ec9dabf6755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:11.715076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1125/2235] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:59:11 2022] DELETE /identity/v3/projects/8cc04b4859da40849e81b9a1585ae233 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:11.719981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.720365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.720878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.729784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:11.747866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:11.749530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:11.822023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1111/2236] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:11.829921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.830547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.830749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.850251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:11.851492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:11.859526 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1126/2237] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:59:11.864507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:11.874323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bf6f6-3c8d-4501-bf18-dc3f23195adb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:11.879448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:11.880105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.880393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.880672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.881401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:59:11.881710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:11.883348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:11.895158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1112/2238] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 08:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:59:11.899523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:11.910993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa130f61-cdbc-4d3e-95d9-0b013e79603c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:11.916157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:11.917205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:11.917377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:11.917657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:11.918377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:11.920288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:11.954005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1127/2239] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 08:59:11 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:11.957963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:11.969405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694e5a2-7d7d-499f-ad21-336f2f9d6b20 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.027440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.028197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.028484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.028792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.029453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.031413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.066641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1113/2240] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 08:59:11 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:59:12.070729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.081983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f1c65-df61-4eb2-9581-b4a9cb283589 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.087025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.087655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.088103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.088479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.097934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.097934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.102602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1128/2241] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:12.107241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.125188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6da78-5aa1-4dcf-b4eb-4e7ff85d82f9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.130652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.131431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.131813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.132187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.133017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.134992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972be1e-3bcb-432b-a049-520d7b543543 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.146857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1114/2242] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 08:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:59:12.151285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.161757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0deda-a288-4bbd-9a53-a2a286ed7d0c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.166343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.167216 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.167499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.167772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] PATH_INFO: `/v3/projects/501be9ede3394d3d89b6252bbbe260a1/users/51211dbb2e41405b98b67ef71c0435ad/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.182784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=501be9ede3394d3d89b6252bbbe260a1, user_id=51211dbb2e41405b98b67ef71c0435ad, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.185444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.199940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1129/2243] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 08:59:12 2022] PUT /identity/v3/projects/501be9ede3394d3d89b6252bbbe260a1/users/51211dbb2e41405b98b67ef71c0435ad/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:12.211312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.211546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.211790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.239120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] MFA Rules not processed for user `51211dbb2e41405b98b67ef71c0435ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:12.240326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:12.303692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:12.307546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1115/2244] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:12.318545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.320239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:12.377055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd1f8-251b-4fd3-a014-2d4922b0229d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.380740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.381389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.381676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.381957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.390323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:12.393693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.395646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6feb5a-c562-48ea-8d58-76814bfc69bc service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.407427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1130/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:12.432160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.497903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d17c9b-1785-4822-9299-856fff8675a5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.502883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.503766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.504052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.504332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] PATH_INFO: `/v3/users/51211dbb2e41405b98b67ef71c0435ad` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.505550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=51211dbb2e41405b98b67ef71c0435ad)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.507513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.555012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51211dbb2e41405b98b67ef71c0435ad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:12.562481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51211dbb2e41405b98b67ef71c0435ad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:12.563097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51211dbb2e41405b98b67ef71c0435ad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:12.570083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51211dbb2e41405b98b67ef71c0435ad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:12.582495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51211dbb2e41405b98b67ef71c0435ad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:12.588495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1116/2246] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 08:59:12 2022] DELETE /identity/v3/users/51211dbb2e41405b98b67ef71c0435ad => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:59:12.592976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.593274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.593561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.610190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:12.612565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:12.670089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1131/2247] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:12.680244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:12.681695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:12.738283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f26-12cc-454a-97aa-c816db3ff5eb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:12.741833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:12.742511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:12.742791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:12.743061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:12.752016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:12.753395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:12.762802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1117/2248] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:13.298546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:13.300626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:13.312790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10504ef-3e8b-4af1-aee7-b1557cccac51 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:13.318052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:13.318945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:13.319235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:13.319505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] PATH_INFO: `/v3/projects/501be9ede3394d3d89b6252bbbe260a1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:13.320692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501be9ede3394d3d89b6252bbbe260a1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:13.322636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:13.368131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501be9ede3394d3d89b6252bbbe260a1', 'request_id': 'req-5c0bf074-c018-4e8e-882d-023eff16f8f8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:13.374997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501be9ede3394d3d89b6252bbbe260a1', 'request_id': 'req-5c0bf074-c018-4e8e-882d-023eff16f8f8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:13.381446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501be9ede3394d3d89b6252bbbe260a1', 'request_id': 'req-5c0bf074-c018-4e8e-882d-023eff16f8f8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:13.391767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] The token cache is being invalidate because project 501be9ede3394d3d89b6252bbbe260a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:59:13.392081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:13.392703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5c0bf074-c018-4e8e-882d-023eff16f8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:59:13.394278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1132/2249] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 08:59:13 2022] DELETE /identity/v3/projects/501be9ede3394d3d89b6252bbbe260a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:59:22.758582 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:23.388852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:31.185123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:31.193940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d590-f0ca-4e74-b872-77ed43026511 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:31.243463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:31.244112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:31.244396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:31.244676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:31.246510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:31.307089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:31.308530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:31.318056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1118/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:36.300654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98713a-8ac6-4fbb-9568-74b7d00e7b88 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:36.301061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98713a-8ac6-4fbb-9568-74b7d00e7b88 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:36.301208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98713a-8ac6-4fbb-9568-74b7d00e7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:36.319027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1c98713a-8ac6-4fbb-9568-74b7d00e7b88 None None] MFA Rules not processed for user `9af0007a1c904e16ab3eb9d0b240f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:36.320235 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1c98713a-8ac6-4fbb-9568-74b7d00e7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:36.378005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1133/2251] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 08:59:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:41.313722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=50 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:44.319656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:44.321740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:44.392681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1179da-d3bf-4a5c-97e1-6ea980877f4f service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:44.398524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:44.399177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:44.399456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:44.399770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:44.401537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:44.413318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:44.414933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:44.425184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1119/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 08:59:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:59:46.369043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=25 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:54.420832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=32 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 08:59:55.329456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e289-6a8b-427b-8142-6e97be26839d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:55.329913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e289-6a8b-427b-8142-6e97be26839d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:55.330036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e289-6a8b-427b-8142-6e97be26839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:55.347880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2982e289-6a8b-427b-8142-6e97be26839d None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:59:55.349056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2982e289-6a8b-427b-8142-6e97be26839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:55.404708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1134/2253] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 08:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:59:55.425842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:55.427310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:55.493279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42553-b10d-4de9-805f-a5b098c2a59c service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:55.498221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:55.498913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:55.499197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:55.499473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:55.508019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:55.509585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc581257-47a8-484f-830f-535e07737a26 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:55.518792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1120/2254] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 08:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:00:05.397833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=25 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:05.514925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=32 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:08.730551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17792-6866-4313-9b66-08c2446f425c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:08.731131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17792-6866-4313-9b66-08c2446f425c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:08.731250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17792-6866-4313-9b66-08c2446f425c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:08.732756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1135/2255] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 09:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:00:08.738904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428389-54e2-4f55-bcf9-376a43d516f2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:08.739393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428389-54e2-4f55-bcf9-376a43d516f2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:08.739521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428389-54e2-4f55-bcf9-376a43d516f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:08.757495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8b428389-54e2-4f55-bcf9-376a43d516f2 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:00:08.758741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8b428389-54e2-4f55-bcf9-376a43d516f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:08.826617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1121/2256] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 09:00:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:00:08.838949 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be17792-6866-4313-9b66-08c2446f425c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:08.840747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9be17792-6866-4313-9b66-08c2446f425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:08.901783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be17792-6866-4313-9b66-08c2446f425c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:08.905286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:08.905934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:08.906379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:08.906662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:08.916766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:08.918225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52198fed-995b-4c94-a8cb-6b99c5c0cea5 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:08.928779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1136/2257] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:00:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:00:08.995276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:08.995562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:08.995839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:08.997211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1122/2258] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 09:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:00:09.002575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d0c6-1ba4-482b-ae5e-79b1cc3f408e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:09.002871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d0c6-1ba4-482b-ae5e-79b1cc3f408e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:09.003154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d0c6-1ba4-482b-ae5e-79b1cc3f408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:09.021357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3225d0c6-1ba4-482b-ae5e-79b1cc3f408e None None] MFA Rules not processed for user `309b1c00398547b8b9924407e36bad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:00:09.022610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3225d0c6-1ba4-482b-ae5e-79b1cc3f408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:09.029166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1137/2259] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 09:00:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:00:09.040445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:09.042215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:09.054960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3efdc-3cc2-4d32-a326-e30ec368afb2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:09.058423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:09.059062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:09.059342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:09.059620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:09.067087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:09.068503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69874b8-fbde-46d3-a11b-85feca9d6b5b service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:09.076503 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1123/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:00:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:00:09.160644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a5099-208e-4d69-870e-bec1cd19be07 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:09.160939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a5099-208e-4d69-870e-bec1cd19be07 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:09.161220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a5099-208e-4d69-870e-bec1cd19be07 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:09.162640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1138/2261] 10.222.0.49 () {54 vars in 921 bytes} [Wed Jul 13 09:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:00:09.168205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67a39-4e3d-4aa9-a4d0-2b109bfc8888 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:09.168527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67a39-4e3d-4aa9-a4d0-2b109bfc8888 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:09.168821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67a39-4e3d-4aa9-a4d0-2b109bfc8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:09.186635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-50e67a39-4e3d-4aa9-a4d0-2b109bfc8888 None None] MFA Rules not processed for user `f847d12027be4164aff8449a2bd42750`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:00:09.187841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-50e67a39-4e3d-4aa9-a4d0-2b109bfc8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:09.197578 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1124/2262] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Jul 13 09:00:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:00:09.208310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a5099-208e-4d69-870e-bec1cd19be07 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:09.219231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a5099-208e-4d69-870e-bec1cd19be07 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:09.222911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:09.223543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:09.223831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:09.224112 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:09.234259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:09.235675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:09.246860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1139/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:00:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:00:11.320619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbb07-7a0e-416c-a84c-2eab3f78c7e3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:11.321081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbb07-7a0e-416c-a84c-2eab3f78c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:11.321184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbb07-7a0e-416c-a84c-2eab3f78c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:11.339061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-473cbb07-7a0e-416c-a84c-2eab3f78c7e3 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:00:11.340283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-473cbb07-7a0e-416c-a84c-2eab3f78c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:11.347429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1125/2264] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:00:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:00:11.359145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:11.370315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c0b21-1ab9-4c15-86bd-fd4b6681e3b0 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:11.375379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:11.375996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:11.376275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:11.377084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:11.384951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:11.386567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:11.395045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1140/2265] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:00:21.334285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=43 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:21.391271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=41 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:36.050696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227bed-7fe6-44e7-9ac5-17e48165dfe6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:36.051179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227bed-7fe6-44e7-9ac5-17e48165dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:36.051284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227bed-7fe6-44e7-9ac5-17e48165dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:36.068619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-84227bed-7fe6-44e7-9ac5-17e48165dfe6 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:00:36.069805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-84227bed-7fe6-44e7-9ac5-17e48165dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:36.076912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1126/2266] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:00:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:00:36.089126 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:36.099759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc91b0-7bfa-420f-943f-85d7208eab3d service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:36.104750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:36.105378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:36.105658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:36.105930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:36.116602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:36.118361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b96-8306-46fa-87ee-c3b2f325e527 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:36.129600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1141/2267] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:00:46.063514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:00:46.126187 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:01:07.715937 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fb23-6bfe-41cd-bc30-5b8ac6e17bd4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:07.716508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fb23-6bfe-41cd-bc30-5b8ac6e17bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:07.716508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fb23-6bfe-41cd-bc30-5b8ac6e17bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:07.733831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-65a7fb23-6bfe-41cd-bc30-5b8ac6e17bd4 None None] MFA Rules not processed for user `cf0d83e0a9074cc580983ed20f6417c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:07.735041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-65a7fb23-6bfe-41cd-bc30-5b8ac6e17bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:07.787955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1127/2268] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:01:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:17.781026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=25 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:01:46.228902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:46.229425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:46.229544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:46.246435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] MFA Rules not processed for user `9af0007a1c904e16ab3eb9d0b240f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:46.247621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:46.254841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1142/2269] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:53.702397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:53.702900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:53.703001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:53.720649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] MFA Rules not processed for user `d8d0bc370fee460ea78320b9e006da77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:53.721853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:53.778477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1128/2270] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:01:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:54.887677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:54.889227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:54.905737 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9968eb-7490-4d93-8b97-0f1fce2cc697 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:54.912734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:54.913461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:54.913748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:54.914050 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:54.919504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:54.931546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:54.933175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:54.943701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1143/2271] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:01:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:57.334252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.343647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396c56c-11a4-4d69-8b8d-6c2158dd5c46 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.347935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.348617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.348903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.349184 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.350988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:57.364057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.365468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.376130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1129/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:58.075418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.077287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.089076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bf7f-2e10-461a-8624-2d957031f364 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.092819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.093468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.093753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.094031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.096519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.109695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.111655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.122744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1144/2273] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:01:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:01.611052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:01.622382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c601a5a-4c52-4232-ac3c-732436197853 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:01.629087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:01.629739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:01.630026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:01.630370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:01.632208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:01.642952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:01.644806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:01.654068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1130/2274] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:08.117783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=15 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:11.649729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=37 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:17.396548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:17.397931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:17.452705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2de52-fae4-498e-9e54-70ad57be1c75 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:17.456272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:17.456912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:17.457195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:17.457472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:17.459224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:17.469667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:17.471643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:17.480443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1145/2275] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:23.983003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:23.997189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381cca1-8a99-4297-b307-3fa4af6fa503 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:24.003653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:24.004467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:24.004881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:24.005162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:24.007355 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:24.021751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:24.023389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:24.035787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1131/2276] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:27.476449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=26 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:34.030198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:36.080098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:36.089809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ed06-acc6-4157-b0c5-da44c83b1338 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:36.093317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:36.093950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:36.094262 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:36.094557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:36.096266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:36.158239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:36.159671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:36.169171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1146/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:39.310447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:39.312701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:39.331816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743c69-5b6c-44c0-8773-2377bed7a4b3 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:39.336419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:39.337301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.337580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.337853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] PATH_INFO: `/v3/users/cf0d83e0a9074cc580983ed20f6417c0` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.339057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0d83e0a9074cc580983ed20f6417c0)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:39.340996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:39.387217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0d83e0a9074cc580983ed20f6417c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.395394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0d83e0a9074cc580983ed20f6417c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.396025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0d83e0a9074cc580983ed20f6417c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.402839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0d83e0a9074cc580983ed20f6417c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.414466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-87101ee1-ac39-4d60-98d3-cf2b5ce96b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0d83e0a9074cc580983ed20f6417c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.420199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1132/2278] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:39 2022] DELETE /identity/v3/users/cf0d83e0a9074cc580983ed20f6417c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:39.590031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:39.600054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410df4f-f675-42aa-a936-6526e6daceba service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:39.656177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:39.657044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.657329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.657603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] PATH_INFO: `/v3/projects/2f3f377b60a442368b5c85acef147a26` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.658796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3f377b60a442368b5c85acef147a26)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:39.660725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:39.705418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3f377b60a442368b5c85acef147a26', 'request_id': 'req-4f3c0438-c987-46d0-b746-adc2661d3fde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.712356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3f377b60a442368b5c85acef147a26', 'request_id': 'req-4f3c0438-c987-46d0-b746-adc2661d3fde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.718487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3f377b60a442368b5c85acef147a26', 'request_id': 'req-4f3c0438-c987-46d0-b746-adc2661d3fde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.728382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] The token cache is being invalidate because project 2f3f377b60a442368b5c85acef147a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:39.728666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.729282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4f3c0438-c987-46d0-b746-adc2661d3fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:39.730824 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1147/2279] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:39 2022] DELETE /identity/v3/projects/2f3f377b60a442368b5c85acef147a26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:39.735859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.736148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.736909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.755083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:39.756270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:39.812322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1133/2280] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:39.820344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.820634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.820911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.838784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:39.839984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:39.848589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1148/2281] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:39.852521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:39.862715 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db429255-f1e4-4b11-8216-d41946323ff9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:39.867334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:39.867987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.868301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.868575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.869299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:39.869603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:39.871206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:39.883118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1134/2282] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:39.887323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:39.896619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c2296-8a2b-41db-9ba4-568bc6e1c07c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:39.901220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:39.901869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:39.902182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:39.902464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:39.903184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:39.905065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:39.919313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:39.932650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1149/2283] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:39 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:39.936564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:39.946314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61acb0-9235-4a02-941e-18fef425683a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:39.999811 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.000468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.000751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.001026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.001690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.004148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.010628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:40.025109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1135/2284] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:39 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:40.029089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.039071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838c58-3ac2-4a45-abb4-8635c492824c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.043600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.044255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.044542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.044821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.045541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.047169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.057473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1150/2285] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:40.061298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.071825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0995-d059-4e54-9d78-360a0cebb9a7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.076325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.076974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.077258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.077536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.078301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.079878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.090174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1136/2286] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:40.094128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.104350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.105581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b82b2-e2ac-4b6a-99cb-ffd5e0087a1c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.107148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.110876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.112715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.113370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.113370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] PATH_INFO: `/v3/projects/e38341fe206842408d3d6fe966fe1b89/users/e326d2bd747247d2b275579c6ec5caee/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.129138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38341fe206842408d3d6fe966fe1b89, user_id=e326d2bd747247d2b275579c6ec5caee, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.131918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97a42-28d0-40fb-acfe-81992107f6c2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.147113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1151/2287] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:40 2022] PUT /identity/v3/projects/e38341fe206842408d3d6fe966fe1b89/users/e326d2bd747247d2b275579c6ec5caee/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:40.158662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.159290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.159550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.178185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621f88-3c17-4792-994e-ea4c71cf735c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.189573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] MFA Rules not processed for user `e326d2bd747247d2b275579c6ec5caee`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:40.190895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.233274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.234279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.234810 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.235100 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.237587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.260009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1152/2288] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:40.273071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.274545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.306293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.308124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.318279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1137/2289] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:02:40.366329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6188-3873-45a8-a6e5-2f3dc9b32666 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.371412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.372072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.372358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.372634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.380866 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.382486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.391794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1153/2290] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:02:40.647265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.649789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.675656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8552-14c6-455d-b6f8-6376d69331a3 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:40.686053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:40.688329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:40.688799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:40.689097 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:40.693735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:40.718390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:40.720022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7ee51-b981-426d-975f-2eddf0fa96e3 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:40.738530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1138/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:40.922891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:40.975519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:41.014338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5ac7a-05d2-4e3a-bd1e-a17a5fbc79ed service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.021417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.022971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.023353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.023722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] PATH_INFO: `/v3/users/e326d2bd747247d2b275579c6ec5caee` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.025344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e326d2bd747247d2b275579c6ec5caee)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.027402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.091677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e326d2bd747247d2b275579c6ec5caee'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.101643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e326d2bd747247d2b275579c6ec5caee'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.103316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e326d2bd747247d2b275579c6ec5caee'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.113298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e326d2bd747247d2b275579c6ec5caee'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.134255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e326d2bd747247d2b275579c6ec5caee'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.140491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1154/2292] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:40 2022] DELETE /identity/v3/users/e326d2bd747247d2b275579c6ec5caee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:41.145264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.145555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.145834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.163996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:41.165218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.197024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:41.227899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1139/2293] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:41.237793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.239414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.298404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0cda-398e-46ef-b8a6-e29a07fbeed9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.302527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.303170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.303451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.303724 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.312690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.314104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.334906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1155/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:02:41.607476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.610755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.626419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.634800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7955cdc-24c9-4272-b3c7-7ab5a3d6a809 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.637285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78fa1-cb57-4a64-be8c-684c5da8c3cd service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.642507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.643571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.643716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.644065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.644431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.644527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.644794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.645069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] PATH_INFO: `/v3/projects/e38341fe206842408d3d6fe966fe1b89` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.646296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38341fe206842408d3d6fe966fe1b89)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.646875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.648200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.657823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.659934 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11dd80-adc5-4222-a831-6bf19d2c3c61 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.670358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1156/2295] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:02:41.700125 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38341fe206842408d3d6fe966fe1b89', 'request_id': 'req-4db9e9ed-4092-4bab-a782-5310bb9253a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.709632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38341fe206842408d3d6fe966fe1b89', 'request_id': 'req-4db9e9ed-4092-4bab-a782-5310bb9253a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.716568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38341fe206842408d3d6fe966fe1b89', 'request_id': 'req-4db9e9ed-4092-4bab-a782-5310bb9253a0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.729211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] The token cache is being invalidate because project e38341fe206842408d3d6fe966fe1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:41.729728 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.730318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4db9e9ed-4092-4bab-a782-5310bb9253a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:41.735455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1140/2296] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:41 2022] DELETE /identity/v3/projects/e38341fe206842408d3d6fe966fe1b89 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:41.737227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.737564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.737852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.757267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:41.758545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.813717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:41.837202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1157/2297] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:41.845085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.845375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.846258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.865123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:41.866318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:41.874795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1141/2298] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:41.879137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.889184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd50e6-5435-4d3f-be08-641db3ca4031 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.894995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.895678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.895963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.896237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.897114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:41.897426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.899078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.915921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1158/2299] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:41.917255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.927649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5745-0a0c-4060-980a-9b4c7c35aad9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:41.932628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:41.933444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:41.933829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:41.934249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:41.935088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:41.937821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:41.970142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1142/2300] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:41 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:41.975167 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:41.985741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffb85-4112-4a85-b718-a3e16782a720 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.050730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.051775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.054565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.055040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.055792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.057761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.094314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1159/2301] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:41 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:42.095454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.112965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386fa-6f3a-47c6-b616-df17b264a538 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.128840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.129644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.130049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.130446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.132239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.133070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.148739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1143/2302] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:42.152554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.173125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97800-edcf-453e-888c-72f98d1a6c05 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.180744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.181757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.182272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.182939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.183854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.186851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b929c46-f2df-4121-92cc-fd70665f44aa admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.210734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.219300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1160/2303] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:42.224202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a683-de55-4ed4-999b-a6df4c720f09 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.229916 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.231245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.231608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.231951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] PATH_INFO: `/v3/projects/6bfa23f5ebf14058b14f5c2a6fb021c8/users/8156ea340f9f430183c6aa8a3b781118/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.249806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfa23f5ebf14058b14f5c2a6fb021c8, user_id=8156ea340f9f430183c6aa8a3b781118, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.253483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.285498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.285817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.286142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.296011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1144/2304] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:42 2022] PUT /identity/v3/projects/6bfa23f5ebf14058b14f5c2a6fb021c8/users/8156ea340f9f430183c6aa8a3b781118/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:42.329467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] MFA Rules not processed for user `8156ea340f9f430183c6aa8a3b781118`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:42.331599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:42.417887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1161/2305] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:42.419193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.505584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:42.515759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe831-5cc8-45b1-a899-cc812933cc4a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.523482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.524553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.524918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.526181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.527120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.529281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.567051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1145/2306] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:42 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:42.572434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.585880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7083d-702c-40ba-987b-b5268e76ef97 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.632202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:42.653529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.654252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.654424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.654705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.656152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.657470 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.686170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1162/2307] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:42 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:42.687098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.697970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3f68-d58d-4161-ab52-5adf551089d2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.703162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.703934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.704319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.704696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.705571 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.707297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.722372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1146/2308] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:02:42.724465 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.737575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e319c-43d5-4c09-a3c6-71fa7c617b21 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.743042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.744349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.744795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.745258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] PATH_INFO: `/v3/projects/d6feeb0766bd426ab62268f833a968b6/users/5d832de9fcc1451595bb13496ad02cf9/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.765275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6feeb0766bd426ab62268f833a968b6, user_id=5d832de9fcc1451595bb13496ad02cf9, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.768521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.790799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1163/2309] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:42 2022] PUT /identity/v3/projects/d6feeb0766bd426ab62268f833a968b6/users/5d832de9fcc1451595bb13496ad02cf9/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:42.792338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.809338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d051d50-6b69-4978-ad3d-2f924fc854f4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.885199 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.886460 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.886820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.887169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.887975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.890770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291cfb4-8526-4eb0-b828-97f081e6a6ad admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.906288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1147/2310] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:02:42.907711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:42.931365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f0bab-79b3-485b-845d-0e8e33c2b514 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:42.947959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:42.949055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.950247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.950532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] PATH_INFO: `/v3/projects/d6feeb0766bd426ab62268f833a968b6/users/5d832de9fcc1451595bb13496ad02cf9/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:42.957546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6feeb0766bd426ab62268f833a968b6, user_id=5d832de9fcc1451595bb13496ad02cf9, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:42.962027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:42.981630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1164/2311] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:42 2022] PUT /identity/v3/projects/d6feeb0766bd426ab62268f833a968b6/users/5d832de9fcc1451595bb13496ad02cf9/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:42.993269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:42.993568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:42.993857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:43.029023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] MFA Rules not processed for user `5d832de9fcc1451595bb13496ad02cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:43.030323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:43.134532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1148/2312] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:43.145810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:43.174348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:43.277667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f316c4-75c7-40e4-af28-e9fcddab6a3f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:43.282789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:43.284681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:43.285583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:43.285878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:43.296955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:43.298435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1cd81-80dd-4c0d-848a-8bb97926a94c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:43.312398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1165/2313] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:43.981256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:44.039999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:44.053606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18de2-a422-4514-8ed4-1afa6bbc32a1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:44.058282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:44.059162 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:44.059447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:44.059722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] PATH_INFO: `/v3/users/8156ea340f9f430183c6aa8a3b781118` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:44.060983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8156ea340f9f430183c6aa8a3b781118)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:44.063066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:44.114255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8156ea340f9f430183c6aa8a3b781118'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.125004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8156ea340f9f430183c6aa8a3b781118'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.125629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8156ea340f9f430183c6aa8a3b781118'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.134708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8156ea340f9f430183c6aa8a3b781118'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.146584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8156ea340f9f430183c6aa8a3b781118'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.153080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1149/2314] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:43 2022] DELETE /identity/v3/users/8156ea340f9f430183c6aa8a3b781118 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:44.157456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:44.157922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:44.158146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:44.176255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:44.178026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:44.243813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1166/2315] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:44.250207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:44.252444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:44.315649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7bb1-2ef1-485a-866c-aed1a8619bc9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:44.319392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:44.320057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:44.320344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:44.320628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:44.329919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:44.331422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:44.341215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1150/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:44.682836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:44.684382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:44.698785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892881c-286a-4b0f-b76d-6cf91577d153 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:44.704004 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:44.705453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:44.705942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:44.706886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] PATH_INFO: `/v3/projects/6bfa23f5ebf14058b14f5c2a6fb021c8` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:44.708744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfa23f5ebf14058b14f5c2a6fb021c8)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:44.711184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:44.749438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:44.767204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfa23f5ebf14058b14f5c2a6fb021c8', 'request_id': 'req-1b3c72ae-c80c-478c-a9c1-82c063948467'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.775957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfa23f5ebf14058b14f5c2a6fb021c8', 'request_id': 'req-1b3c72ae-c80c-478c-a9c1-82c063948467'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.782674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfa23f5ebf14058b14f5c2a6fb021c8', 'request_id': 'req-1b3c72ae-c80c-478c-a9c1-82c063948467'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.794154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] The token cache is being invalidate because project 6bfa23f5ebf14058b14f5c2a6fb021c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:44.794289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.794940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.796489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1167/2317] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:44 2022] DELETE /identity/v3/projects/6bfa23f5ebf14058b14f5c2a6fb021c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:44.800962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:44.810361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f8dd-5ac3-4e80-8a60-d2bb69e8e94d service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:44.867450 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:44.868328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:44.868609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:44.868884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] PATH_INFO: `/v3/users/5d832de9fcc1451595bb13496ad02cf9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:44.870062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d832de9fcc1451595bb13496ad02cf9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:44.871999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:44.885360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:44.918869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d832de9fcc1451595bb13496ad02cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.928012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d832de9fcc1451595bb13496ad02cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.928797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d832de9fcc1451595bb13496ad02cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.936691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d832de9fcc1451595bb13496ad02cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.949210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-61de7450-7b71-4d3e-9f86-d0522405a868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d832de9fcc1451595bb13496ad02cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:44.955927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1151/2318] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:44 2022] DELETE /identity/v3/users/5d832de9fcc1451595bb13496ad02cf9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:45.293041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.294597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:45.306953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c72ae-c80c-478c-a9c1-82c063948467 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.376131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.377456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.377716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.378233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] PATH_INFO: `/v3/projects/d6feeb0766bd426ab62268f833a968b6` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.379666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6feeb0766bd426ab62268f833a968b6)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.381906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.425874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6feeb0766bd426ab62268f833a968b6', 'request_id': 'req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:45.432540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6feeb0766bd426ab62268f833a968b6', 'request_id': 'req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:45.438686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6feeb0766bd426ab62268f833a968b6', 'request_id': 'req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:45.449246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] The token cache is being invalidate because project d6feeb0766bd426ab62268f833a968b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:45.449533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:45.450197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e3511ae6-c48f-4c1c-aec1-dee9d1c597f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:45.451719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1168/2319] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:45 2022] DELETE /identity/v3/projects/d6feeb0766bd426ab62268f833a968b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:45.457414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.457868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.457963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.477144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:45.478352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:45.536431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1152/2320] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:45.544157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.544452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.544757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.562897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:45.564086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:45.572424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1169/2321] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:45.576391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.586028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd7486-5b50-4e5d-a118-9b4bdeb2a65c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.590652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.591316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.591601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.591879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.592609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:45.592913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.594545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.606419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1153/2322] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:45.612306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.621038 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311a53-0708-46e8-bd18-0aa44d8f1aa9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.625795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.626384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.626747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.627567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.628254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.630193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.662161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1170/2323] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:45 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:45.663434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.673429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e834-c4d5-45b3-81a4-03592c8b11b1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.728181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.728864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.729146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.729422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.730106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.732033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.755320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1154/2324] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:45 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:02:45.759619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.772099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafd89-c760-4b92-b50d-32c8a4a8c928 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.778617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.778617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.782440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.782931 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.783974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.786428 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.806789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1171/2325] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:45.811185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.823127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64f75-95b3-4434-be30-9ea9e5676788 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.828069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.828795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.829089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.829373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.830206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.831797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f99f-bf70-4237-8b3c-c6014e5f8675 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.834176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:45.844223 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1155/2326] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:45.850460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:45.860743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a708-5b79-45b2-9b2c-ffa106b0c3ef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:45.866104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:45.867080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.867439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.867725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] PATH_INFO: `/v3/projects/c710a920474748cbb0af9d3d5f061e6f/users/82c574b9bbc44326aca1e257fa52eb9b/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.871399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:45.885292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c710a920474748cbb0af9d3d5f061e6f, user_id=82c574b9bbc44326aca1e257fa52eb9b, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:45.888039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:45.901013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1172/2327] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:45 2022] PUT /identity/v3/projects/c710a920474748cbb0af9d3d5f061e6f/users/82c574b9bbc44326aca1e257fa52eb9b/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:45.912465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:45.912816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:45.913055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:45.941201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] MFA Rules not processed for user `82c574b9bbc44326aca1e257fa52eb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:45.942477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:46.006333 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1156/2328] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:46.010577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.073056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d6c1c-761a-46fb-a86c-ac7d9f491c74 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.078154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.078823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.079108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.079394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.080097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.082007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.110480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1173/2329] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:46 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:46.113008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.124320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5478-fe11-46a1-b72a-f3134500fd7d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.187416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.188105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.188392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.188672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.189456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.191461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.211627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1157/2330] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:46 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:46.215661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.226302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c630a6d-f1f3-46a2-a08b-4c2f5d54316f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.230860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.231520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.231800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.232070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.232792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.234539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.245434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1174/2331] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:46.249721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.261524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8814d-87ea-40de-86a9-aeb137a85d67 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.266381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.267921 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.268551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.268825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] PATH_INFO: `/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c/users/390f49fa82dd47f798a74ecf8202527f/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.284666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb47d0dff1a4b65954ae283e6d3db8c, user_id=390f49fa82dd47f798a74ecf8202527f, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.287325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.300785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1158/2332] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:46 2022] PUT /identity/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c/users/390f49fa82dd47f798a74ecf8202527f/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:46.304932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.315145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d293ba-10ac-43d4-b0fe-09521c4dcf81 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.388664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.389600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.390369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.390369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.390980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.393362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8ed9a-5e5d-41cf-86fc-190b72b259a3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.404257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1175/2333] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:46.409889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.422304 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f6a2-1c21-4eb8-bc6b-dc926a53ce93 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.427407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.428388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.428748 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.429099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] PATH_INFO: `/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c/users/390f49fa82dd47f798a74ecf8202527f/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.431358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb47d0dff1a4b65954ae283e6d3db8c, user_id=390f49fa82dd47f798a74ecf8202527f, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.434245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.445978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1159/2334] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:46 2022] PUT /identity/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c/users/390f49fa82dd47f798a74ecf8202527f/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:46.456991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.457372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.457661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.489009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] MFA Rules not processed for user `390f49fa82dd47f798a74ecf8202527f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:46.490358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:46.550055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:46.584859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1176/2335] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:46.597008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.599005 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:46.652079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:46.668469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8605-ce91-4683-878b-fbb82507493f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.672477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.673146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.673414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.673722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.683282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.684797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1132f-7fb5-4c7e-8b1e-2bf8d6231413 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.695129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1160/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:46.754340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:46.756098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:46.769415 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4085b1-9ed1-4f0e-b3c6-d54a1b12de85 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:46.773349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:46.774009 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:46.774334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:46.774615 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:46.838904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:46.840340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:46.849501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1177/2337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:47.926816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:47.927362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:47.927362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:47.944807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] MFA Rules not processed for user `176c63d8d42745d5b3ca3d2ae52ca23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:47.946013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:48.006142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1161/2338] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:48.336188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:48.337697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:48.405299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d345-c297-4954-a508-0765c975ee92 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:48.409293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:48.410061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:48.410396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:48.410657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:48.412505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:48.423435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:48.424933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1c20f-b8ae-4147-8140-e4cd0ee72573 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:48.436058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1178/2339] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:48.791107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:48.792594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:48.865825 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384434a6-4672-4368-b87d-7501cc84f949 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:48.870950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:48.871618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:48.871899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:48.872168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:48.873968 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:48.886094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:48.887651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:48.898852 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1162/2340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:49.038695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:49.039073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:49.039429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:49.059337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:49.060683 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:49.132791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1179/2341] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:02:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:49.210252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:49.212043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:49.286165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134630f-fccd-4ca1-a5be-a516cb135d8b service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:49.291409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:49.292545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:49.292545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:49.292835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:49.301187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:49.302792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e5a38-b340-4014-be8b-22469430e70a service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:49.311517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1163/2342] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:02:50.365603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:50.397606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:50.448840 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800740dd-bf87-45b4-b9b6-add1df20b77c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:50.454044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:50.455130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:50.455264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:50.455715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] PATH_INFO: `/v3/users/82c574b9bbc44326aca1e257fa52eb9b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:50.456938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c574b9bbc44326aca1e257fa52eb9b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:50.458913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:50.512793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c574b9bbc44326aca1e257fa52eb9b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:50.521697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c574b9bbc44326aca1e257fa52eb9b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:50.522677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c574b9bbc44326aca1e257fa52eb9b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:50.531375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c574b9bbc44326aca1e257fa52eb9b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:50.551029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c574b9bbc44326aca1e257fa52eb9b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:50.558011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1180/2343] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:50 2022] DELETE /identity/v3/users/82c574b9bbc44326aca1e257fa52eb9b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:50.562483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:50.562977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:50.563077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:50.582075 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:50.589840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:50.591531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:50.675903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1164/2344] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:50.705999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:50.708176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:50.821442 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74054389-1292-46c2-b11c-da1582419740 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:50.830165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:50.831130 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:50.831505 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:50.831876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:50.848762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:50.850345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:50.861242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1181/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:51.730030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:51.732118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:51.746680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63224ec-28fc-4cdc-8583-1f83812ded9b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:51.752784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:51.753665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:51.753956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:51.754448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] PATH_INFO: `/v3/projects/c710a920474748cbb0af9d3d5f061e6f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:51.756523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c710a920474748cbb0af9d3d5f061e6f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:51.759094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:51.826756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c710a920474748cbb0af9d3d5f061e6f', 'request_id': 'req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:51.835713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c710a920474748cbb0af9d3d5f061e6f', 'request_id': 'req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:51.842470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c710a920474748cbb0af9d3d5f061e6f', 'request_id': 'req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:51.858760 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] The token cache is being invalidate because project c710a920474748cbb0af9d3d5f061e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:51.859295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:51.860338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:51.862826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1165/2346] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:51 2022] DELETE /identity/v3/projects/c710a920474748cbb0af9d3d5f061e6f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:51.867431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:51.883835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca73fb-3ebf-448e-801b-0927e9b4a1eb service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:51.963879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:51.999318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:52.000157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:52.000443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:52.000719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] PATH_INFO: `/v3/users/390f49fa82dd47f798a74ecf8202527f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:52.002297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] RBAC: Authorizing `identity:delete_user(user_id=390f49fa82dd47f798a74ecf8202527f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:52.004960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:52.072443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390f49fa82dd47f798a74ecf8202527f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.081011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390f49fa82dd47f798a74ecf8202527f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.083310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390f49fa82dd47f798a74ecf8202527f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.092424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390f49fa82dd47f798a74ecf8202527f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.113988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1887d78c-1f56-4c3c-82b3-2f269c79806d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390f49fa82dd47f798a74ecf8202527f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.128990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1182/2347] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:51 2022] DELETE /identity/v3/users/390f49fa82dd47f798a74ecf8202527f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:52.660829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:52.662291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:52.678471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7fc7-6f54-4cfe-922c-3c4fe8202550 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:52.751169 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:52.752744 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:52.753099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:52.753447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] PATH_INFO: `/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:52.754765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb47d0dff1a4b65954ae283e6d3db8c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:52.756756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:52.796988 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:52.821618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb47d0dff1a4b65954ae283e6d3db8c', 'request_id': 'req-fbd74074-1d08-47d5-bd45-42dc93b76d19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.833334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb47d0dff1a4b65954ae283e6d3db8c', 'request_id': 'req-fbd74074-1d08-47d5-bd45-42dc93b76d19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.841491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb47d0dff1a4b65954ae283e6d3db8c', 'request_id': 'req-fbd74074-1d08-47d5-bd45-42dc93b76d19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.857995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] The token cache is being invalidate because project 3cb47d0dff1a4b65954ae283e6d3db8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:52.858360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.859028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fbd74074-1d08-47d5-bd45-42dc93b76d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:52.861064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1166/2348] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:52 2022] DELETE /identity/v3/projects/3cb47d0dff1a4b65954ae283e6d3db8c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:52.866039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:52.866364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:52.866635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:52.905018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:52.906990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:52.998449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1183/2349] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:53.007001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.007284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.007587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.026284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:53.027507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:53.035552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1167/2350] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:53.039793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.050684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9879ab-02da-4eee-88ef-3297f29bc989 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.056192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.057085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.057383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.057655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.058423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:53.058736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.060344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.074984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1184/2351] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:53.079371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.089212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64bed8-3993-41b8-8c55-0e1e05eef02f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.093981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.094729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.095016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.095294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.095989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.097907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.139957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1168/2352] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:53.141169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.151522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1a2d6-9451-42bd-8baf-07c94c521470 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.213023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:53.221351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.222479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.223407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.223781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.224570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.226803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.253751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1185/2353] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:53.255598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.266572 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348883-8c02-443f-a255-5fe89f43aac4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.271821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.272493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.272779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.273058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.273789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.275624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.289218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1169/2354] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:53.290870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.311194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5a15-e362-45ae-84e7-8ecba58a9554 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.346242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.346242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.346242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.346242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.347407 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.349114 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbec869-43de-4042-8438-2225cd338b55 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.380777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1186/2355] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:53.382570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.393358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754c02a-0ebf-45a9-bd36-f176f30ee825 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.399508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.400553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.400737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.401017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] PATH_INFO: `/v3/projects/4aba4f30353d4db4adaf536a5b0a643d/users/6ce21d9ea8fa42e8874b9d4035d48ed3/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.418146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aba4f30353d4db4adaf536a5b0a643d, user_id=6ce21d9ea8fa42e8874b9d4035d48ed3, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.421248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.439905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1170/2356] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:53 2022] PUT /identity/v3/projects/4aba4f30353d4db4adaf536a5b0a643d/users/6ce21d9ea8fa42e8874b9d4035d48ed3/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:53.451523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.451905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.452250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.483192 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] MFA Rules not processed for user `6ce21d9ea8fa42e8874b9d4035d48ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:53.484614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:53.576312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1187/2357] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:53.577595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.654527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18548-7aa0-4b2f-9f7a-f23ed57a6fee admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.661653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.662504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.663053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.663787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.665528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.668047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.709560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1171/2358] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:53.713228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.726085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd008373-7aa0-411d-b621-2f52ca92316c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.796468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.797340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.797730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.798289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.799094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.801163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.822158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1188/2359] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:53 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:53.825608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.836838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b4047-fba6-4985-95a2-933195429a89 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.841747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.842456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.842741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.843027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.843787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.845940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.856754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1172/2360] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:53.860900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.877555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab4b-5b7c-41c5-8a91-e0e70dca2c9c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.882312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:53.883215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:53.883492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:53.883768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] PATH_INFO: `/v3/projects/9922ce9ef1154f5c8e7123668ef47202/users/788082b283ad49d4ba7aaee3a2f54bcc/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:53.901475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9922ce9ef1154f5c8e7123668ef47202, user_id=788082b283ad49d4ba7aaee3a2f54bcc, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:53.904382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:53.922256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1189/2361] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:53 2022] PUT /identity/v3/projects/9922ce9ef1154f5c8e7123668ef47202/users/788082b283ad49d4ba7aaee3a2f54bcc/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:53.924128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:53.935993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887748-53b2-455e-9bd1-d103be2d9ddf admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:53.969360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:54.009486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:54.010302 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:54.010761 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:54.011192 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:54.011950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:54.013630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac3010-bd1d-4378-8e09-d8541a7ec4fe admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:54.025346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1173/2362] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:54.029656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:54.040775 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac244e9-3b14-4017-854c-bad30e526fef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:54.045635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:54.046705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:54.047090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:54.047469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] PATH_INFO: `/v3/projects/9922ce9ef1154f5c8e7123668ef47202/users/788082b283ad49d4ba7aaee3a2f54bcc/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:54.049592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9922ce9ef1154f5c8e7123668ef47202, user_id=788082b283ad49d4ba7aaee3a2f54bcc, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:54.052416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:54.063777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1190/2363] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:54 2022] PUT /identity/v3/projects/9922ce9ef1154f5c8e7123668ef47202/users/788082b283ad49d4ba7aaee3a2f54bcc/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:54.074662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:54.075035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:54.075534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:54.103226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] MFA Rules not processed for user `788082b283ad49d4ba7aaee3a2f54bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:54.104523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:54.173250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1174/2364] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:54.184163 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:54.186138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:54.206676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:54.245335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f897-876a-458c-abe3-cf38dc3e0dbd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:54.249758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:54.250045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:54.250361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:54.250639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:54.261406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:54.262886 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:54.273419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1191/2365] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:54.317840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:54.319284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:54.331556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98553-cff7-4327-a9b0-6d67da37be26 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:54.335122 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:54.335773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:54.336055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:54.336332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:54.396034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:54.397499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:54.406669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1175/2366] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:57.451718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:57.453228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:57.526378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17596f3-110d-4dce-9654-8e1141652e7a service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:57.530788 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:57.531650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:57.531928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:57.532197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] PATH_INFO: `/v3/users/1d045efdc421474b9da55688be0ea24b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:57.533392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d045efdc421474b9da55688be0ea24b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:57.535327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:57.580352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d045efdc421474b9da55688be0ea24b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.587521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d045efdc421474b9da55688be0ea24b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.588357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d045efdc421474b9da55688be0ea24b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.595430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d045efdc421474b9da55688be0ea24b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.606946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d045efdc421474b9da55688be0ea24b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.613308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1192/2367] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:57 2022] DELETE /identity/v3/users/1d045efdc421474b9da55688be0ea24b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:57.850525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:57.852129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:57.854584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:57.865629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26413d0-3fdc-457e-a66c-5331f287c63a service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:57.901899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:57.920677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:57.930161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4d08-4141-4136-8f56-476c46daa828 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:57.931424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:57.932300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:57.932580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:57.932854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] PATH_INFO: `/v3/users/6ce21d9ea8fa42e8874b9d4035d48ed3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:57.934045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce21d9ea8fa42e8874b9d4035d48ed3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:57.934897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:57.935749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:57.935985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:57.936111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:57.936297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] PATH_INFO: `/v3/projects/9ac03ee9f83d40c59435cbfbdd189338` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:57.937459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac03ee9f83d40c59435cbfbdd189338)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:57.939394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:57.983197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce21d9ea8fa42e8874b9d4035d48ed3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.988454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac03ee9f83d40c59435cbfbdd189338', 'request_id': 'req-6078f2dc-4a07-4b8c-96c6-39490795d477'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.991953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce21d9ea8fa42e8874b9d4035d48ed3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.993498 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce21d9ea8fa42e8874b9d4035d48ed3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:57.996361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac03ee9f83d40c59435cbfbdd189338', 'request_id': 'req-6078f2dc-4a07-4b8c-96c6-39490795d477'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.000974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce21d9ea8fa42e8874b9d4035d48ed3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.002658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac03ee9f83d40c59435cbfbdd189338', 'request_id': 'req-6078f2dc-4a07-4b8c-96c6-39490795d477'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.012961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c9db5118-80f0-4387-b7e2-ad215cedd171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce21d9ea8fa42e8874b9d4035d48ed3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.013175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] The token cache is being invalidate because project 9ac03ee9f83d40c59435cbfbdd189338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:58.013488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.014150 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.015704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1193/2368] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:57 2022] DELETE /identity/v3/projects/9ac03ee9f83d40c59435cbfbdd189338 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:58.019600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1176/2369] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:57 2022] DELETE /identity/v3/users/6ce21d9ea8fa42e8874b9d4035d48ed3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:58.019828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.021146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.025197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.025490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.025771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.043406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:58.044690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.085736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f2dc-4a07-4b8c-96c6-39490795d477 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.103737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1177/2370] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:58.114639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.116078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.143996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.144878 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.145160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.145436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] PATH_INFO: `/v3/users/1b96912a051948be9066f2b09957942c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.146675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b96912a051948be9066f2b09957942c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.148589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.165103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:58.173826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85949611-fa73-43f4-b8eb-0be1b4ac8678 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.178294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.179012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.179369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.179713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.189914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.191628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.197570 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b96912a051948be9066f2b09957942c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.201683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1178/2371] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:02:58.206507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b96912a051948be9066f2b09957942c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.207141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b96912a051948be9066f2b09957942c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.214954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b96912a051948be9066f2b09957942c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.227439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b96912a051948be9066f2b09957942c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.233668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1194/2372] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:58 2022] DELETE /identity/v3/users/1b96912a051948be9066f2b09957942c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:58.416146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.427095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18d19-b5b1-439f-b537-c38272062c76 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.437487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:58.481120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.484098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.503132 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.504149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.504438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.504714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] PATH_INFO: `/v3/projects/bb2a71279fbd400ea35a3357b82b94e1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.506084 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2a71279fbd400ea35a3357b82b94e1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.508293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.568700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2a71279fbd400ea35a3357b82b94e1', 'request_id': 'req-80e48030-71ac-45f4-8deb-a8515793bbc8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.573592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8491-d237-4af7-8a3d-ce8847d7aa82 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.577682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2a71279fbd400ea35a3357b82b94e1', 'request_id': 'req-80e48030-71ac-45f4-8deb-a8515793bbc8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.584151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2a71279fbd400ea35a3357b82b94e1', 'request_id': 'req-80e48030-71ac-45f4-8deb-a8515793bbc8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.597879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] The token cache is being invalidate because project bb2a71279fbd400ea35a3357b82b94e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:58.598191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.598861 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-80e48030-71ac-45f4-8deb-a8515793bbc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.600510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1179/2373] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:58 2022] DELETE /identity/v3/projects/bb2a71279fbd400ea35a3357b82b94e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:58.605434 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.605651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.605945 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.625194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:58.626628 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.646103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.647195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.647835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.648183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] PATH_INFO: `/v3/projects/4aba4f30353d4db4adaf536a5b0a643d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.649774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aba4f30353d4db4adaf536a5b0a643d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.652076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.694742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1180/2374] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:58.695705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.696908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.705879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:58.710539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aba4f30353d4db4adaf536a5b0a643d', 'request_id': 'req-e9435790-ff7b-4651-bdd5-c59c4b599620'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.722088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aba4f30353d4db4adaf536a5b0a643d', 'request_id': 'req-e9435790-ff7b-4651-bdd5-c59c4b599620'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.729534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aba4f30353d4db4adaf536a5b0a643d', 'request_id': 'req-e9435790-ff7b-4651-bdd5-c59c4b599620'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.741212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] The token cache is being invalidate because project 4aba4f30353d4db4adaf536a5b0a643d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:58.741497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.742162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e9435790-ff7b-4651-bdd5-c59c4b599620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.743758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1195/2375] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:58 2022] DELETE /identity/v3/projects/4aba4f30353d4db4adaf536a5b0a643d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:58.747395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.747680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.747959 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.754214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:58.767546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:58.769072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.782349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b06089-d86e-4cd8-bbee-3a523c079c05 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.828013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1196/2376] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:58.829017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.830401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.841789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935407-bed0-4aca-aab5-96e02e0165fe None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.846206 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.846859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.847138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.847413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.847594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.848443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.848730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.849010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] PATH_INFO: `/v3/users/788082b283ad49d4ba7aaee3a2f54bcc` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.849178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:58.850228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788082b283ad49d4ba7aaee3a2f54bcc)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.852140 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.862621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.864139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.874614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1181/2377] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:58.875402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.886310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e5c7a-5a51-455c-86b9-2349655e0355 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.893580 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.894276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.894556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.894830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.895547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:58.895850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.897555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.911686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788082b283ad49d4ba7aaee3a2f54bcc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.915816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1182/2378] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:58.917159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.920747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788082b283ad49d4ba7aaee3a2f54bcc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.921508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788082b283ad49d4ba7aaee3a2f54bcc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.929849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ac21-2112-4689-a94a-8063ada34da2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:58.933100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788082b283ad49d4ba7aaee3a2f54bcc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.936177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:58.937011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:58.937294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:58.938158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:58.938925 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:58.941014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:58.949157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788082b283ad49d4ba7aaee3a2f54bcc'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:58.956938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1197/2379] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:02:58 2022] DELETE /identity/v3/users/788082b283ad49d4ba7aaee3a2f54bcc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:58.974602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1183/2380] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:58 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:58.978986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:58.980600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.040411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:59.061600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721d883-080f-40ef-bfbd-d080929834d7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.125087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.125699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.125987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.126373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.127067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.129043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.150243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1198/2381] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:58 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:59.155551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.178218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba902c-1acb-4e66-bbed-07731691cb93 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.184910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.185967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.186341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.186697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.187526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.189213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.201066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1184/2382] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:59.206100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.216682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bff-2d75-4937-b709-7e5f4d5d5bc4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.223094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.223981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.224273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.224595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.225326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.226961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40510c81-55a1-4a7c-8678-90de0c6f9eb9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.242965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1199/2383] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:59.244157 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.254565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a352bb-e610-4676-95cf-6e1c1dd9b4f9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.259226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.260178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.260667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.260939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] PATH_INFO: `/v3/projects/44118768a2ce4f5b8ebcfa2352e2c915/users/d0d227ce30ea4dd8832cd6536ddd5093/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.280267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44118768a2ce4f5b8ebcfa2352e2c915, user_id=d0d227ce30ea4dd8832cd6536ddd5093, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.283539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.297657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1185/2384] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:59 2022] PUT /identity/v3/projects/44118768a2ce4f5b8ebcfa2352e2c915/users/d0d227ce30ea4dd8832cd6536ddd5093/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:02:59.302844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.303285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.303640 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.321850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:59.323133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.385034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1200/2385] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:02:59.396639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.397492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.398710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.398900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.410985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f08767-5d94-4c18-96f4-c55ffec046ff None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.415697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.416557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.416837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.417107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] PATH_INFO: `/v3/projects/9922ce9ef1154f5c8e7123668ef47202` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.418480 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9922ce9ef1154f5c8e7123668ef47202)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.420425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.470493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9922ce9ef1154f5c8e7123668ef47202', 'request_id': 'req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:59.470731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de691-e851-490a-a8a4-d242de8458a8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.478175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9922ce9ef1154f5c8e7123668ef47202', 'request_id': 'req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:59.480756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:59.484560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9922ce9ef1154f5c8e7123668ef47202', 'request_id': 'req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:59.488706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:02:59.497053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] The token cache is being invalidate because project 9922ce9ef1154f5c8e7123668ef47202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:02:59.498060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:59.499341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc54eaa3-d2a4-4bb7-9c6b-146bc5f5b5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:02:59.505872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1201/2386] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:02:59 2022] DELETE /identity/v3/projects/9922ce9ef1154f5c8e7123668ef47202 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:59.507437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1e9-038b-480a-80f9-2e9bd8fe6529 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.507727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1e9-038b-480a-80f9-2e9bd8fe6529 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.508002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1e9-038b-480a-80f9-2e9bd8fe6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.523360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.524014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.524299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.524576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.526089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a5f4c1e9-038b-480a-80f9-2e9bd8fe6529 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:59.526384 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.527294 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a5f4c1e9-038b-480a-80f9-2e9bd8fe6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.586368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1202/2387] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:59.588969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.590562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.594052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.594362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.594639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.600951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1186/2388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:59.612246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:59.613444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:59.621546 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1203/2389] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:59.626765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.636963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a597f-daef-4e57-977f-d718ab8bddeb service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.641716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.643323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.643678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.644026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.644821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:59.645216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.646901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.658492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1187/2390] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:59.662787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.672453 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e635a8-34c5-4270-8440-a0e85fc938c2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.678276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.678943 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.679225 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.679501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.680182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.682260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.712657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1204/2391] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:59.714198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.724631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef2bb6-b04e-4ed5-8c63-7398ec491f97 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.787814 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.788490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.788772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.789044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.789858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.791803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.812025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1188/2392] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:59.816885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.827540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8961-4e19-4c5b-a407-5d1c71c5f5fd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.832479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.833242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.833598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.833948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.834740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.836532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.849025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1205/2393] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:59.854318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.865956 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f6bc-d963-426f-91d7-42025be15589 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.870996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.872032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.872170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.872574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.873412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.875134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd64ab-a58e-4075-bd46-36240be61305 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.886884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1189/2394] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:59.890998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:59.903076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e70d-f7ba-4480-9960-283e1cec1d13 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:59.911817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:59.913148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.913607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.914434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] PATH_INFO: `/v3/projects/3a311d559b5e431aab1ff8af6e95cb3f/users/45bc6f848c4f419892904995135f55d3/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:59.934890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a311d559b5e431aab1ff8af6e95cb3f, user_id=45bc6f848c4f419892904995135f55d3, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:59.938608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:59.958154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1206/2395] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:02:59 2022] PUT /identity/v3/projects/3a311d559b5e431aab1ff8af6e95cb3f/users/45bc6f848c4f419892904995135f55d3/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:59.969402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:59.969826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:59.970335 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.009051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] MFA Rules not processed for user `45bc6f848c4f419892904995135f55d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:00.010617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:00.030018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:00.082707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1190/2396] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:00.093807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:00.096222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:00.155799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba375f-37c7-4303-99bc-14fea7ab1278 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:00.159976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:00.160667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:00.160948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:00.161223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.170829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:00.171924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4a3d-b23e-48ba-8c80-b00e05b39aa3 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:00.182558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1207/2397] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:00.201616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:00.272008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443ba42-ec6e-4b64-a07e-f61312731098 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:00.277150 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:00.278185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:00.278604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:00.279085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] PATH_INFO: `/v3/users/45bc6f848c4f419892904995135f55d3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.280585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bc6f848c4f419892904995135f55d3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:00.288613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:00.342523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bc6f848c4f419892904995135f55d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:00.357877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bc6f848c4f419892904995135f55d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:00.358737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bc6f848c4f419892904995135f55d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:00.367165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bc6f848c4f419892904995135f55d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:00.379141 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bc6f848c4f419892904995135f55d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:00.385096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1191/2398] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:03:00 2022] DELETE /identity/v3/users/45bc6f848c4f419892904995135f55d3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:00.389544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:00.389834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:00.390128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.408276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:00.409403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:00.441845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:00.485552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1208/2399] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:03:00.494022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:00.495757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:00.555591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:00.580676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c87107-6f83-4de2-aed1-81fa3dd1da22 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:00.585089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:00.586171 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:00.586562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:00.586940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.601759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:00.603378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e051-ee39-464b-983c-d36c7a16e693 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:00.630337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1192/2400] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:00.958599 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:00.960120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:00.979089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ef89a-7e03-4e6b-8a73-e50435987f96 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:00.984341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:00.985217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:00.985609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:00.985887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] PATH_INFO: `/v3/projects/3a311d559b5e431aab1ff8af6e95cb3f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:00.987155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a311d559b5e431aab1ff8af6e95cb3f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:00.989127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.056348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a311d559b5e431aab1ff8af6e95cb3f', 'request_id': 'req-307cd3e5-378e-4364-8f2a-3970bdcc40dd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:01.065969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a311d559b5e431aab1ff8af6e95cb3f', 'request_id': 'req-307cd3e5-378e-4364-8f2a-3970bdcc40dd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:01.073340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a311d559b5e431aab1ff8af6e95cb3f', 'request_id': 'req-307cd3e5-378e-4364-8f2a-3970bdcc40dd'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:01.088785 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] The token cache is being invalidate because project 3a311d559b5e431aab1ff8af6e95cb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:03:01.088993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:01.089722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-307cd3e5-378e-4364-8f2a-3970bdcc40dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:01.091656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1209/2401] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:03:00 2022] DELETE /identity/v3/projects/3a311d559b5e431aab1ff8af6e95cb3f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:01.096531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.097213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.097213 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.129515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:01.131188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:01.209959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1193/2402] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:03:01.212124 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.212421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.212695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.232560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:01.234213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:01.247552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1210/2403] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:01.248309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.259477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264f59-c071-42e9-998e-7c73eafb916c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.265756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.267196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.268530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.269565 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.270668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:03:01.271494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.273688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.291144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1194/2404] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:03:01.295772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.306531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd252f-bb2f-4e4a-b360-5332d65897b4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.311666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.312661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.313016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.313417 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.314862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.316960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.358803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1211/2405] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:03:01 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:03:01.359927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.385605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11be9f-ab3c-4635-af46-1e20eb9e41f4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.473289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.481186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.481703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.481984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.482754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.484777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.516217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1195/2406] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:03:01 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:03:01.522568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.539411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f1b8-5d4b-4273-a1ec-9ff3eead3346 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.550739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.552293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.552293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.552293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.553350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.554545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.583469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1212/2407] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:03:01.587186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.612680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664569b-a128-4140-b4c5-cf949d2e2c29 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.639457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.640323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.640612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.640892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.641634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.643799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19763d18-aa4e-4954-94ae-77119128ba61 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.662602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1196/2408] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:03:01.663322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.674332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f7ab-febc-4c67-ac95-76c3871671a7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.679131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.680032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.680317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.680596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] PATH_INFO: `/v3/projects/5d5e2560def74ce5b4868860805f369d/users/5f345f5354214689a141a94b1e025f42/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.697229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5e2560def74ce5b4868860805f369d, user_id=5f345f5354214689a141a94b1e025f42, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.699837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.714496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1213/2409] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:03:01 2022] PUT /identity/v3/projects/5d5e2560def74ce5b4868860805f369d/users/5f345f5354214689a141a94b1e025f42/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:03:01.726339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602a8ca-6807-4132-b4bb-56de026c3893 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.726632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602a8ca-6807-4132-b4bb-56de026c3893 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.726913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602a8ca-6807-4132-b4bb-56de026c3893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.755605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2602a8ca-6807-4132-b4bb-56de026c3893 None None] MFA Rules not processed for user `5f345f5354214689a141a94b1e025f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:01.756830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2602a8ca-6807-4132-b4bb-56de026c3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:01.799048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:01.841026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1197/2410] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:01.852863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:01.854603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:01.920025 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbd21-17aa-447e-b5c1-599ee4e99d8f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:01.925118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:01.926001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:01.926467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:01.926862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:01.934101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:01.937716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:01.940157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:01.951652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1214/2411] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:04.692265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a69b-4103-4540-abff-076509f81662 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:04.692750 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a69b-4103-4540-abff-076509f81662 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:04.692880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a69b-4103-4540-abff-076509f81662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:04.724099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2297a69b-4103-4540-abff-076509f81662 None None] MFA Rules not processed for user `d0d227ce30ea4dd8832cd6536ddd5093`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:04.725430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2297a69b-4103-4540-abff-076509f81662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:04.814146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1198/2412] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:04.818002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:04.819681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:04.919995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a033e6-942d-420d-adc6-c798b25fd724 service glance] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:04.925398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:04.926258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:04.926618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:04.926967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:04.927740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:04.929717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:04.964286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1215/2413] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:03:04 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:03:04.967354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a69b-4103-4540-abff-076509f81662 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:04.980482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a69b-4103-4540-abff-076509f81662 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:05.051908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:05.052603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:05.052887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:05.053165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:05.053913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:05.055908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:05.080624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1199/2414] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:03:04 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:03:05.084385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:05.095504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f678-4db8-43e5-8334-fe9c0195cde3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:05.106129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:05.106940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:05.107226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:05.107667 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:05.108363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:05.110033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:05.121711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1216/2415] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:03:05.127225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:05.137726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932bd5-6d35-4fa8-9ae0-3f81d8d03652 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:05.143890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:05.144927 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:05.145240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:05.145561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] PATH_INFO: `/v3/projects/c6ef53b6c16140919fb24bf1180f310d/users/b148a699ba534df297340045cec3733a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:05.162178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ef53b6c16140919fb24bf1180f310d, user_id=b148a699ba534df297340045cec3733a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:05.165253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:05.187160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1200/2416] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:03:05 2022] PUT /identity/v3/projects/c6ef53b6c16140919fb24bf1180f310d/users/b148a699ba534df297340045cec3733a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:05.191035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:05.202390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a614a3-1936-4f2d-8a91-41ee40bdf8f7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:05.284591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:05.285288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:05.285578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:05.285935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:05.286634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:05.289136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a70-a425-4195-bd2a-7b734a9dafa4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:05.302067 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1217/2417] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:03:05.316120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:05.334338 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db352-4fdc-4e22-8b77-80f8db03fa8f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:05.340272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:05.341764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:05.341764 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:05.342377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] PATH_INFO: `/v3/projects/c6ef53b6c16140919fb24bf1180f310d/users/b148a699ba534df297340045cec3733a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:05.345997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ef53b6c16140919fb24bf1180f310d, user_id=b148a699ba534df297340045cec3733a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:05.352966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:05.366165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1201/2418] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:03:05 2022] PUT /identity/v3/projects/c6ef53b6c16140919fb24bf1180f310d/users/b148a699ba534df297340045cec3733a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:09.994014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705990-e638-4598-83f0-8d91d55f218b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:09.994651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705990-e638-4598-83f0-8d91d55f218b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:09.994651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705990-e638-4598-83f0-8d91d55f218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:10.023026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06705990-e638-4598-83f0-8d91d55f218b None None] MFA Rules not processed for user `b148a699ba534df297340045cec3733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:10.026049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06705990-e638-4598-83f0-8d91d55f218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:10.083497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:10.108762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1218/2419] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:10.124907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:10.126784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:10.153106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:10.210706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438813db-8667-4ac7-b40c-876ea8701051 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:10.216405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:10.217142 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:10.217424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:10.217700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:10.283437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:10.285032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:10.294366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1202/2420] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:11.364616 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbca55-a802-4b89-aa5d-5e49f2f93327 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:11.365086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbca55-a802-4b89-aa5d-5e49f2f93327 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:11.365181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbca55-a802-4b89-aa5d-5e49f2f93327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:11.389701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a6fbca55-a802-4b89-aa5d-5e49f2f93327 None None] MFA Rules not processed for user `d0d227ce30ea4dd8832cd6536ddd5093`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:11.390954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a6fbca55-a802-4b89-aa5d-5e49f2f93327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:11.399137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1219/2421] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:20.294656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=48 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:21.377554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:30.420970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:30.483103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ea72-7689-427c-9ba7-14d0f5f7d7fe service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:30.487592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:30.488459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:30.488741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:30.489016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] PATH_INFO: `/v3/users/5f345f5354214689a141a94b1e025f42` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:30.490224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f345f5354214689a141a94b1e025f42)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:30.492683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:30.536244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f345f5354214689a141a94b1e025f42'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:30.542557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f345f5354214689a141a94b1e025f42'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:30.543242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f345f5354214689a141a94b1e025f42'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:30.549973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f345f5354214689a141a94b1e025f42'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:30.561886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f345f5354214689a141a94b1e025f42'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:30.567610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1203/2422] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:03:30 2022] DELETE /identity/v3/users/5f345f5354214689a141a94b1e025f42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:30.572729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:30.573210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:30.573318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:30.590136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:30.591354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:30.648855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1220/2423] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:30.658632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:30.660056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:30.715269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea85b5-0c41-48f5-9def-2304c1a62341 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:30.718890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:30.719526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:30.719806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:30.720079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:30.729794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:30.731281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7aebb-710d-4dec-a44c-473a51e9eacb service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:30.740508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1204/2424] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:31.007483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.009044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.030663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41de337-2ca4-495f-8748-53dc0dbfb3cb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.035490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.036430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.037952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.037952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] PATH_INFO: `/v3/projects/5d5e2560def74ce5b4868860805f369d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.039108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5e2560def74ce5b4868860805f369d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.041003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.089588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5e2560def74ce5b4868860805f369d', 'request_id': 'req-5fc15b73-5730-442d-83aa-a6d3ba00168c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:31.097751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5e2560def74ce5b4868860805f369d', 'request_id': 'req-5fc15b73-5730-442d-83aa-a6d3ba00168c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:31.105249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5e2560def74ce5b4868860805f369d', 'request_id': 'req-5fc15b73-5730-442d-83aa-a6d3ba00168c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:31.118751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] The token cache is being invalidate because project 5d5e2560def74ce5b4868860805f369d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:03:31.119039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:31.119694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:03:31.121579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1221/2425] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:03:31 2022] DELETE /identity/v3/projects/5d5e2560def74ce5b4868860805f369d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:31.126275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297d6-196a-45ba-93d1-2b526884d484 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.126640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297d6-196a-45ba-93d1-2b526884d484 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.126982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297d6-196a-45ba-93d1-2b526884d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.145481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-52f297d6-196a-45ba-93d1-2b526884d484 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:31.147294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-52f297d6-196a-45ba-93d1-2b526884d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.160774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.162247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.166217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:31.210103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1205/2426] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:31.217665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.217957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.218277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.221731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b73-5730-442d-83aa-a6d3ba00168c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.225981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.226661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.226944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.227222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.229004 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.235926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:31.237089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.238693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.240109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.244974 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1206/2427] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:03:31.248283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1222/2428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:03:31.249034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.257850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb892cb-4b21-4369-824d-6cea20485444 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.262462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.263115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.263400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.263675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.264394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:03:31.264700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.266314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.279323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1207/2429] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:03:31.283490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.295320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdce4-148a-4282-936f-affe778fbef5 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.299875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.300522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.300807 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.301082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.301780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.303774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.332828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1223/2430] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:03:31 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:03:31.333975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.350610 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768467f8-f37c-47de-97e5-088da59b4f03 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.404590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.405264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.405547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.405824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.406537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.408461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.432505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1208/2431] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:03:31 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:03:31.434680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.442079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:31.446585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c16ba5-9608-4d47-8977-3335c3004336 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.453313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.454043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.454547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.455119 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.456245 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.458441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.470614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1224/2432] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:03:31.474779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.484880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b1a40-a519-45ec-a59d-e648ef6e1f1f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.489470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.490151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.490437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.490742 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.491487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.494204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc9d0d-e8a7-4d33-9258-86e7d05bae0d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.503118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1209/2433] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:03:31.507974 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.525650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4027-22a0-4b54-beb1-e377eced715f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.530741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.531717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.532072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.532420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] PATH_INFO: `/v3/projects/cea5ea36a5e24f489ef67203341c7a27/users/1c26a9d4b3f2433384931a55550cbce8/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.548782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea5ea36a5e24f489ef67203341c7a27, user_id=1c26a9d4b3f2433384931a55550cbce8, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.551587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.564936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1225/2434] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:03:31 2022] PUT /identity/v3/projects/cea5ea36a5e24f489ef67203341c7a27/users/1c26a9d4b3f2433384931a55550cbce8/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:03:31.576345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.576655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.576936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.610060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] MFA Rules not processed for user `1c26a9d4b3f2433384931a55550cbce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:31.611416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.688417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1210/2435] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:31.705377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:31.707282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:31.781678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7f50-9beb-4aca-9f7c-fbd4d55f7afe admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:31.785534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:31.786230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:31.786517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:31.786795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:31.796106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:31.797579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368aa2-52f2-4b00-ba00-291e14c26821 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:31.807074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1226/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:41.683407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:41.802440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:45.028829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:45.102665 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c92a8a-21fc-4b39-bdc8-8ff10cc90439 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:45.106315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:45.107032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:45.107317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:45.107595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:45.115650 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:45.196546 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:45.198246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7942-ac3b-4c2b-8548-2c6630046c5c service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:45.208161 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1211/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:03:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:03:48.213260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:48.213755 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:48.213850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:48.242279 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] MFA Rules not processed for user `9af0007a1c904e16ab3eb9d0b240f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:48.243954 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:48.316097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1227/2438] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:03:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:55.203778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=50 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:58.308550 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=25 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:03:58.901522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:58.902065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:58.902276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:58.923799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:03:58.925026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:58.998348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1212/2439] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:03:59.044477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:59.045989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:59.123277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902438f-5721-4391-90d8-d55e44beeb7a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:59.128330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:59.128982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:59.129263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:59.129532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:59.138897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:59.140473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b6fe-8799-40e8-9485-fa5efdd177b5 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:59.148967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1228/2440] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:04:08.416660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:08.496856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf24e-e342-41db-83fb-7e760eeb3813 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:08.501918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:08.503072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:08.503355 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:08.503629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] PATH_INFO: `/v3/users/1c26a9d4b3f2433384931a55550cbce8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:08.504834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c26a9d4b3f2433384931a55550cbce8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:08.506879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:08.558506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c26a9d4b3f2433384931a55550cbce8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:08.566585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c26a9d4b3f2433384931a55550cbce8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:08.567262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c26a9d4b3f2433384931a55550cbce8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:08.576820 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c26a9d4b3f2433384931a55550cbce8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:08.597538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c26a9d4b3f2433384931a55550cbce8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:08.605236 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1213/2441] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:04:08 2022] DELETE /identity/v3/users/1c26a9d4b3f2433384931a55550cbce8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:04:08.610020 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:08.610504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:08.611048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:08.632885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:04:08.634139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:08.714735 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1229/2442] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:04:08.722680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:08.725149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:08.767035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:08.816648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5ddd-b515-4793-a3f9-f45b3ead5a0c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:08.820989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:08.821734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:08.822023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:08.822334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:08.834394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:08.835838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64abf13-2110-4f74-b4fe-c57a67bd8f40 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:08.846577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1214/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:04:09.180733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:09.182287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:09.198474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bdfcf-f4db-4336-8f94-63e111cccc15 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:09.203777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:09.204996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:09.205375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:09.205812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] PATH_INFO: `/v3/projects/cea5ea36a5e24f489ef67203341c7a27` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:09.207388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea5ea36a5e24f489ef67203341c7a27)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:09.212597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:09.275928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea5ea36a5e24f489ef67203341c7a27', 'request_id': 'req-88d55b78-1096-4798-8b4e-0d16edf82ad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:09.288255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea5ea36a5e24f489ef67203341c7a27', 'request_id': 'req-88d55b78-1096-4798-8b4e-0d16edf82ad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:09.296801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea5ea36a5e24f489ef67203341c7a27', 'request_id': 'req-88d55b78-1096-4798-8b4e-0d16edf82ad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:09.308982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] The token cache is being invalidate because project cea5ea36a5e24f489ef67203341c7a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:04:09.309363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:09.310173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:04:09.311971 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1230/2444] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:04:09 2022] DELETE /identity/v3/projects/cea5ea36a5e24f489ef67203341c7a27 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:04:16.367196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3657bb-03f9-46d1-8413-23296f12ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:16.367652 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3657bb-03f9-46d1-8413-23296f12ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:16.367743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3657bb-03f9-46d1-8413-23296f12ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:16.385559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ec3657bb-03f9-46d1-8413-23296f12ccc4 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:04:16.386795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ec3657bb-03f9-46d1-8413-23296f12ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:16.440173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1215/2445] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:04:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:04:16.452361 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:16.453752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:16.467665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:16.523837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d55b78-1096-4798-8b4e-0d16edf82ad0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:16.528756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:16.529387 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:16.529666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:16.529936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:16.537753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:16.539347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:16.547190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1231/2446] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:04:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:04:26.433152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=40 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:26.543983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=26 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:37.281233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:37.281691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:37.281826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:37.319620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:04:37.320860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:37.353566 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1216/2447] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:04:37.365695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:37.406170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244843be-26f7-44d2-afdb-c33d71982401 service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:37.411182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:37.411816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:37.412100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:37.412376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:37.421239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:37.422849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:37.431426 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1232/2448] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:04:45.243554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:45.244969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:45.334668 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6e74e-b5c6-42ca-8950-dda72690c40b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:45.340394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:45.341047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:45.341331 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:45.341609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:45.343387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:45.354689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:45.356275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:45.366235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1217/2449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:04:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:04:47.427662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=20 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:04:55.361960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=64 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:00.484301 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:00.485710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:00.563340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803ef9-2460-420b-a3e6-067c3d4b2a0c service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:00.567041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:00.567684 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:00.567967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:00.568243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:00.570565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:00.653789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:00.655158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:00.674084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1233/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:03.656837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:03.669850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4f72-7cd9-4322-8e46-9829de558e05 service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:03.675640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:03.676416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:03.676783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:03.677120 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:03.679443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:03.692047 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:03.693719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:03.707092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1218/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:03.718909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:03.720806 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:03.740253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9093-468a-4232-8007-488c97665474 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:03.745529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:03.746431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:03.746709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:03.746980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] PATH_INFO: `/v3/users/176c63d8d42745d5b3ca3d2ae52ca23a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:03.748302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176c63d8d42745d5b3ca3d2ae52ca23a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:03.750523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:03.799844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176c63d8d42745d5b3ca3d2ae52ca23a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:03.806549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176c63d8d42745d5b3ca3d2ae52ca23a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:03.807242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176c63d8d42745d5b3ca3d2ae52ca23a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:03.809247 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:03.814939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176c63d8d42745d5b3ca3d2ae52ca23a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:03.827867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-30b83536-13e0-41df-83ca-b769418e85c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176c63d8d42745d5b3ca3d2ae52ca23a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:03.833729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1234/2452] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:03 2022] DELETE /identity/v3/users/176c63d8d42745d5b3ca3d2ae52ca23a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:04.002893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.021647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b55f7-e2f8-42f8-b9f4-7de78a998fd1 service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.080003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.080856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.081138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.081411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] PATH_INFO: `/v3/projects/64229e0e0f76439881e6f029ded9d214` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.082622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64229e0e0f76439881e6f029ded9d214)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.084531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.133792 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64229e0e0f76439881e6f029ded9d214', 'request_id': 'req-64e87010-b763-4571-b18a-072555edc5d7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:04.141332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64229e0e0f76439881e6f029ded9d214', 'request_id': 'req-64e87010-b763-4571-b18a-072555edc5d7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:04.146975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64229e0e0f76439881e6f029ded9d214', 'request_id': 'req-64e87010-b763-4571-b18a-072555edc5d7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:04.157680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] The token cache is being invalidate because project 64229e0e0f76439881e6f029ded9d214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:04.157963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:04.158623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-64e87010-b763-4571-b18a-072555edc5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:04.160140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1219/2453] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:04 2022] DELETE /identity/v3/projects/64229e0e0f76439881e6f029ded9d214 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:04.165531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.165819 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.166097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.220136 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:04.221263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:04.279272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1235/2454] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:04.287410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.288185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.288470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.306949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:04.308158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:04.316262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1220/2455] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:04.320452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.329978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171456b-20f4-4909-b6d5-4e791994f650 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.334649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.335306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.335589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.335862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.336588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:04.336897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.338517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.350001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1236/2456] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:05:04.354556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.363531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de674e6-6c92-4fd5-b548-6a0c6ac80381 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.368801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.369445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.369724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.369996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.370730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.372590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.396844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1221/2457] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:04 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:04.401317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.411348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48346799-fdf4-4428-9b57-d70ff32c7893 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.469092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.469762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.470046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.470413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.471066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.472990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.492907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1237/2458] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:04 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:04.497033 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.507655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8736-036c-4376-b617-9bfa9385a7b0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.512235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.512886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.513166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.513438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.514176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.516003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.526414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1222/2459] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:04.530151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.539933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b504-7e4f-4784-b538-45aa84e6dc78 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.544789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.545447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.545734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.546012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.546766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.548373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dee86a-b306-426b-80f9-ccf96852ea4b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.560571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1238/2460] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:04.564593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.575135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c59a5-aa89-44f2-99dc-fe28d4c8fa94 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.579678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.580573 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.580853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.581127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] PATH_INFO: `/v3/projects/2142e65d62ee4d1b80f7736a60d0bfc5/users/b436a721edd4463cb9717be0075a5492/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.595155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2142e65d62ee4d1b80f7736a60d0bfc5, user_id=b436a721edd4463cb9717be0075a5492, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.597779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.610785 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1223/2461] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:04 2022] PUT /identity/v3/projects/2142e65d62ee4d1b80f7736a60d0bfc5/users/b436a721edd4463cb9717be0075a5492/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:04.621276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037358ee-1a13-481a-a214-50629d308060 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.621563 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037358ee-1a13-481a-a214-50629d308060 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.621838 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037358ee-1a13-481a-a214-50629d308060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.639454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:04.650358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-037358ee-1a13-481a-a214-50629d308060 None None] MFA Rules not processed for user `b436a721edd4463cb9717be0075a5492`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:04.651847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-037358ee-1a13-481a-a214-50629d308060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:04.713927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1239/2462] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:04.725133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:04.727370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:04.745402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:04.821640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf168469-fa20-4a7c-86e1-7638de5daaaf admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:04.827126 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:04.827767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:04.828049 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:04.828319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:04.835872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:04.837436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf138-6274-40c0-bd4e-16d244bcfe9c service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:04.845986 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1224/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:07.495894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037358ee-1a13-481a-a214-50629d308060 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:07.553816 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037358ee-1a13-481a-a214-50629d308060 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:07.558790 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:07.559651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:07.559935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:07.560210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] PATH_INFO: `/v3/users/b436a721edd4463cb9717be0075a5492` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:07.561381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b436a721edd4463cb9717be0075a5492)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:07.563326 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:07.607483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b436a721edd4463cb9717be0075a5492'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:07.614524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b436a721edd4463cb9717be0075a5492'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:07.615132 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b436a721edd4463cb9717be0075a5492'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:07.622477 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b436a721edd4463cb9717be0075a5492'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:07.634766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b436a721edd4463cb9717be0075a5492'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:07.640794 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1240/2464] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:07 2022] DELETE /identity/v3/users/b436a721edd4463cb9717be0075a5492 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:07.645326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:07.645791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:07.645889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:07.662902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:07.664146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:07.720906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1225/2465] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:07.730918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:07.732293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:07.752278 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:07.791487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c7980-7afd-4e25-bd31-0a58dc39cce9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:07.795134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:07.795780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:07.796063 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:07.796340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:07.805677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:07.807115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61d7c-0f74-4d70-ae82-1d3101eeeede service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:07.816682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1241/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:08.082654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.084090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:08.096262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9c4f-cb4e-4e9b-9fef-9672664c0b73 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.100804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.102427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.102709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.103004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] PATH_INFO: `/v3/projects/2142e65d62ee4d1b80f7736a60d0bfc5` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.104185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2142e65d62ee4d1b80f7736a60d0bfc5)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.106087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.159555 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2142e65d62ee4d1b80f7736a60d0bfc5', 'request_id': 'req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:08.167677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2142e65d62ee4d1b80f7736a60d0bfc5', 'request_id': 'req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:08.173366 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2142e65d62ee4d1b80f7736a60d0bfc5', 'request_id': 'req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:08.184579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] The token cache is being invalidate because project 2142e65d62ee4d1b80f7736a60d0bfc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:08.184867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:08.185493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ecc0fe-3b19-49f3-90c8-2e760edb63c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:08.187093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1226/2467] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:08 2022] DELETE /identity/v3/projects/2142e65d62ee4d1b80f7736a60d0bfc5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:08.192125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.192462 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.192746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.209928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:08.211692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:08.269355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1242/2468] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:08.277411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.277698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.277972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.284212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:08.298186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:08.299375 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:08.307152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1227/2469] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:08.311384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.321861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca3cc-15f6-4997-9506-9292bf6dc72c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.326529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.327185 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.327471 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.327751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.328472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:08.328781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.330444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.342419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1243/2470] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:05:08.346378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.356035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb03c-3af0-448a-8abe-b70990f18efd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.360585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.361220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.361499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.361786 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.362495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.364353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.392101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1228/2471] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:08 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:08.393190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.403668 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35e29-24ec-426a-8c4b-800503055478 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.459580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.460250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.461125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.461401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.462131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.464109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.484264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1244/2472] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:08 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:08.488409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.498490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6302-8745-431c-bb61-be0c9cefaf20 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.503077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.503730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.504040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.504317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.505039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.506658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.517679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1229/2473] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:08.521444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.532026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f47c-d092-4547-876b-e6dc649c1322 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.536761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.537423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.537712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.537994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.538762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.540388 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6fc5a-80dd-4168-9404-97ba544df056 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.550474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1245/2474] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:08.554191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.564395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9063-c3a0-4275-bbf0-df60742ba617 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.568928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.570317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.570601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.570875 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] PATH_INFO: `/v3/projects/f827e272f43f4817ac6213bf3c051755/users/de389014f8e14d5eb8dda384592cb6e2/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.586634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f827e272f43f4817ac6213bf3c051755, user_id=de389014f8e14d5eb8dda384592cb6e2, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.589262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.602048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1230/2475] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:08 2022] PUT /identity/v3/projects/f827e272f43f4817ac6213bf3c051755/users/de389014f8e14d5eb8dda384592cb6e2/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:08.613399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.613696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.613980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.640658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] MFA Rules not processed for user `de389014f8e14d5eb8dda384592cb6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:08.641868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:08.655251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:08.707071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1246/2476] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:08.718404 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:08.720201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:08.797088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b0f3-220c-477e-9546-35514de450f3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:08.800756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:08.801435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:08.801723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:08.802003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:08.810408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:08.811834 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c8bf-f990-47fc-8279-6e1c1e466a98 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:08.821063 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1231/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:17.037605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.097037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c4918-b232-4124-9275-3fb6a0028c1f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.101547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.102437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.102717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.102988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] PATH_INFO: `/v3/users/de389014f8e14d5eb8dda384592cb6e2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.104148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de389014f8e14d5eb8dda384592cb6e2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.106051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:17.153117 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de389014f8e14d5eb8dda384592cb6e2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.159639 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de389014f8e14d5eb8dda384592cb6e2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.160353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de389014f8e14d5eb8dda384592cb6e2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.167090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de389014f8e14d5eb8dda384592cb6e2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.178491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de389014f8e14d5eb8dda384592cb6e2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.184745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1247/2478] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:17 2022] DELETE /identity/v3/users/de389014f8e14d5eb8dda384592cb6e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:17.189241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.189736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.189842 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.207592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:17.208787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:17.267399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1232/2479] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:17.277173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.278606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:17.318900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:17.338844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f34f6-c033-438e-b475-00361913475f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.342445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.343087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.343370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.343643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.352383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.353798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b56a-47f3-40ce-8ea7-6d8ea15d6925 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:17.363201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1248/2480] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:17.621513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.622997 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:17.636361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c1a7-31ac-4108-a36d-c007b1fc406d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.641954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.643025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.643320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.643579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] PATH_INFO: `/v3/projects/f827e272f43f4817ac6213bf3c051755` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.644874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f827e272f43f4817ac6213bf3c051755)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.646681 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:17.664364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:17.694601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f827e272f43f4817ac6213bf3c051755', 'request_id': 'req-9254d599-8865-49de-8e67-f7154c4c3b55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.701700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f827e272f43f4817ac6213bf3c051755', 'request_id': 'req-9254d599-8865-49de-8e67-f7154c4c3b55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.707189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f827e272f43f4817ac6213bf3c051755', 'request_id': 'req-9254d599-8865-49de-8e67-f7154c4c3b55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.717798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] The token cache is being invalidate because project f827e272f43f4817ac6213bf3c051755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:17.718079 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.718714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9254d599-8865-49de-8e67-f7154c4c3b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:17.720240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1233/2481] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:17 2022] DELETE /identity/v3/projects/f827e272f43f4817ac6213bf3c051755 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:17.725087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.725393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.725672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.743743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:17.745004 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:17.803257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1249/2482] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:17.812284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.812284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.812540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.830587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:17.831798 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:17.840308 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1234/2483] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:17.844608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.855054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81d8ad-92c5-443f-8021-f59514cd0bed None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.859875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.860641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.861037 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.861370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.862153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:17.862524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.864468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:17.876057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1250/2484] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:17.880407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.889528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7532-a1b9-4455-91f4-9d3aeae4982d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.894437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.895087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.895370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.895646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.896353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.898812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:17.923552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1235/2485] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:17 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:17.927606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:17.937405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238221-71be-46f9-a940-1be3ab8039cc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:17.993259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:17.993925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:17.994237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:17.994516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:17.995198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:17.997078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.017058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1251/2486] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:17 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:18.020560 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.031319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a280997-7032-4fdf-b79a-32e181812859 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.035908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.036568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.036855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.037156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.037863 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.040149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.050511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1236/2487] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:18.053879 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.063747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8b2f-4782-47ea-a762-7473bb15e768 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.068274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.068921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.069204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.069481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.070227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.071791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca35037-1faa-41dd-96b5-1339672bc286 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.081402 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1252/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:05:18.085934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.095639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce321b1-dc13-4e28-8746-0b82d814417f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.100297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.101702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.101991 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.102306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] PATH_INFO: `/v3/projects/9d8d10570c9443cb8461a1ec7692bec2/users/ca08f7774d124234a26989d4fd3246a1/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.116729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8d10570c9443cb8461a1ec7692bec2, user_id=ca08f7774d124234a26989d4fd3246a1, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.119437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.132398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1237/2489] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:18 2022] PUT /identity/v3/projects/9d8d10570c9443cb8461a1ec7692bec2/users/ca08f7774d124234a26989d4fd3246a1/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:18.144069 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.144367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.144644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.171349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] MFA Rules not processed for user `ca08f7774d124234a26989d4fd3246a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:18.172540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:18.203860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:18.236853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1253/2490] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:18.241231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.300541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4f5b5-9a0c-4303-a5b1-8ab3af5928a1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.305296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.305891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.306200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.306478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.307154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.309042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.334621 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1238/2491] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:18.339198 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.349845 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cf6f-efb7-47f9-bd99-76c70a35379c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.404730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.405395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.405681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.405958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.406665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.408552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.427498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1254/2492] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:18.431344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.441320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afde00e-847e-449e-93e1-8f8e3feaa8b1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.446419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.447070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.447350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.447623 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.448337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.449905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.461057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1239/2493] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:18.464918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.474746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102074-6c21-49e9-a594-cd49a74874bc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.479307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.479964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.480252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.480533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.481256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.482877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb059-f316-4420-b907-0d1ef0186213 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.492619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1255/2494] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:05:18.496493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.506332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbb16-941a-4a48-8550-1e511ede3755 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.511417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.512296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.512581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.512860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] PATH_INFO: `/v3/projects/cc824ae3a2004f5b8c1408dd5c71c1a2/users/ff82cb07fd6a4a6ebc2a65622bb2338a/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.525268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:18.528547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc824ae3a2004f5b8c1408dd5c71c1a2, user_id=ff82cb07fd6a4a6ebc2a65622bb2338a, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.531374 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.544447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1240/2495] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:18 2022] PUT /identity/v3/projects/cc824ae3a2004f5b8c1408dd5c71c1a2/users/ff82cb07fd6a4a6ebc2a65622bb2338a/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:18.554463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.554795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.555081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.581975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] MFA Rules not processed for user `ff82cb07fd6a4a6ebc2a65622bb2338a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:18.583159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:18.645675 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1256/2496] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:18.650221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.710411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e587819-40f0-408b-81ff-4a160d951408 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.715072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.715772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.716080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.716364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.717057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.719011 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.743723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1241/2497] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:18.747893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.759259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd408-95ab-4499-84b1-020a6a949907 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.798252 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:18.815490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.816157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.816444 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.816721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.817413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.819356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.838656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1257/2498] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:18 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:18.842552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.852823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee29-31f1-485b-9bfd-37e9e3985d2c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.857902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.858602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.858890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.859168 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.859902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.861489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.873248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1242/2499] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:18.877133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.887394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dcb36-7dbd-4590-9b2a-8eace9273bd5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.892289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.893188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.893473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.893752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] PATH_INFO: `/v3/projects/7014ecd2f70b401481d05f034d8d0945/users/253bed2ec13144fea9cc1798110cf1e2/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.908010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7014ecd2f70b401481d05f034d8d0945, user_id=253bed2ec13144fea9cc1798110cf1e2, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.910728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:18.923597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1258/2500] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:18 2022] PUT /identity/v3/projects/7014ecd2f70b401481d05f034d8d0945/users/253bed2ec13144fea9cc1798110cf1e2/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:18.927367 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:18.937615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d024b6-aa55-4dff-8ad9-05a498b09a76 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:18.991363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:18.992025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:18.992310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:18.992587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:18.993838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:18.995470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d828-bcce-45c1-b7ff-de4ad5731d30 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:19.005469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1243/2501] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:19.009802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:19.020329 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b049be-6f83-48c4-abc7-7cf56cfd2ff7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:19.024923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:19.025797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:19.026082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:19.026400 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] PATH_INFO: `/v3/projects/7014ecd2f70b401481d05f034d8d0945/users/253bed2ec13144fea9cc1798110cf1e2/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:19.028360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7014ecd2f70b401481d05f034d8d0945, user_id=253bed2ec13144fea9cc1798110cf1e2, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:19.030998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:19.041381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1259/2502] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:19 2022] PUT /identity/v3/projects/7014ecd2f70b401481d05f034d8d0945/users/253bed2ec13144fea9cc1798110cf1e2/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:19.051292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:19.051585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:19.051869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:19.078052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] MFA Rules not processed for user `253bed2ec13144fea9cc1798110cf1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:19.079289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:19.125394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:19.147408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1244/2503] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:19.157988 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:19.159791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:19.220200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a5d67-5a16-43c3-8b75-6f0d0c6a5be1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:19.228231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:19.228872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:19.229155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:19.229437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:19.246560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:19.247993 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:19.257358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1260/2504] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:19.736869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:19.738381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:19.750128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe75e-9bd1-483f-94dc-ef06b4631598 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:19.753632 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:19.754387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:19.754673 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:19.754948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:19.809663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:19.811124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:19.819733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1245/2505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:23.774647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:23.783255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd07e8-981f-4aed-9cec-c1c982d64fce service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:23.786796 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:23.787427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:23.787710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:23.787987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:23.843787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:23.845147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deea36-8083-4a24-8e3b-fe9f9e33974c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:23.854380 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1261/2506] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:25.864644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:25.925060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2c98d-5342-48b5-992f-1276df5bde7a service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:25.929551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:25.930486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:25.930767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:25.931040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] PATH_INFO: `/v3/users/ca08f7774d124234a26989d4fd3246a1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:25.932210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca08f7774d124234a26989d4fd3246a1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:25.934123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:25.979515 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca08f7774d124234a26989d4fd3246a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:25.986466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca08f7774d124234a26989d4fd3246a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:25.987134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca08f7774d124234a26989d4fd3246a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:25.994232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca08f7774d124234a26989d4fd3246a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.006052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca08f7774d124234a26989d4fd3246a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.012406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1246/2507] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:25 2022] DELETE /identity/v3/users/ca08f7774d124234a26989d4fd3246a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:26.017507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:26.018042 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:26.018196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:26.035398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:26.036604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:26.067108 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:26.096027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1262/2508] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:26.105415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:26.106854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:26.113554 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:26.166143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072514-6828-4516-90ca-ee667e66ac2b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:26.169693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:26.170364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:26.170647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:26.170923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:26.179637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:26.181569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:26.190804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1247/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:26.452264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:26.453777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:26.465757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4130a-9d71-4ee7-8fe7-a570272b513b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:26.470773 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:26.471707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:26.471992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:26.472264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] PATH_INFO: `/v3/projects/9d8d10570c9443cb8461a1ec7692bec2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:26.473476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8d10570c9443cb8461a1ec7692bec2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:26.475379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:26.520834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8d10570c9443cb8461a1ec7692bec2', 'request_id': 'req-7941627d-9981-4640-ae0a-93cc24853fb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.527760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8d10570c9443cb8461a1ec7692bec2', 'request_id': 'req-7941627d-9981-4640-ae0a-93cc24853fb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.533770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8d10570c9443cb8461a1ec7692bec2', 'request_id': 'req-7941627d-9981-4640-ae0a-93cc24853fb9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.544200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] The token cache is being invalidate because project 9d8d10570c9443cb8461a1ec7692bec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:26.544482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.545102 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.546648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1263/2510] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:26 2022] DELETE /identity/v3/projects/9d8d10570c9443cb8461a1ec7692bec2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:26.550653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:26.560795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8964-ab0f-45f0-902c-3c783ab7c45b service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:26.614934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:26.615731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:26.616012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:26.616288 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] PATH_INFO: `/v3/users/ff82cb07fd6a4a6ebc2a65622bb2338a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:26.617457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff82cb07fd6a4a6ebc2a65622bb2338a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:26.620014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:26.662854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff82cb07fd6a4a6ebc2a65622bb2338a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.670307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff82cb07fd6a4a6ebc2a65622bb2338a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.670976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff82cb07fd6a4a6ebc2a65622bb2338a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.677879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff82cb07fd6a4a6ebc2a65622bb2338a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.689919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff82cb07fd6a4a6ebc2a65622bb2338a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:26.695711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1248/2511] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:26 2022] DELETE /identity/v3/users/ff82cb07fd6a4a6ebc2a65622bb2338a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:26.958940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:26.960424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:26.981457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941627d-9981-4640-ae0a-93cc24853fb9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.038001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.038895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.039180 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.039472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] PATH_INFO: `/v3/projects/cc824ae3a2004f5b8c1408dd5c71c1a2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.041242 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc824ae3a2004f5b8c1408dd5c71c1a2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.043196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.087770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc824ae3a2004f5b8c1408dd5c71c1a2', 'request_id': 'req-b189b4c4-6fbb-445e-92cd-b2d583d63606'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.095670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc824ae3a2004f5b8c1408dd5c71c1a2', 'request_id': 'req-b189b4c4-6fbb-445e-92cd-b2d583d63606'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.101841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc824ae3a2004f5b8c1408dd5c71c1a2', 'request_id': 'req-b189b4c4-6fbb-445e-92cd-b2d583d63606'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.103674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:27.115524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] The token cache is being invalidate because project cc824ae3a2004f5b8c1408dd5c71c1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:27.115991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.116802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.118421 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1264/2512] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:26 2022] DELETE /identity/v3/projects/cc824ae3a2004f5b8c1408dd5c71c1a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:27.122379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:27.123878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:27.136845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945442-488b-4824-b68b-78bb518e5e29 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.161072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:27.195215 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.196577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.196859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.197134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] PATH_INFO: `/v3/users/253bed2ec13144fea9cc1798110cf1e2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.198337 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=253bed2ec13144fea9cc1798110cf1e2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.200246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.244111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253bed2ec13144fea9cc1798110cf1e2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.252736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253bed2ec13144fea9cc1798110cf1e2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.253364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253bed2ec13144fea9cc1798110cf1e2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.261491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253bed2ec13144fea9cc1798110cf1e2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.274813 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ca2db354-af99-449b-9121-a6f104babd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253bed2ec13144fea9cc1798110cf1e2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.280754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1249/2513] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:27 2022] DELETE /identity/v3/users/253bed2ec13144fea9cc1798110cf1e2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:27.540781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:27.542287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:27.557001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b4c4-6fbb-445e-92cd-b2d583d63606 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.613413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.614348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.614635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.614913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] PATH_INFO: `/v3/projects/7014ecd2f70b401481d05f034d8d0945` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.616090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7014ecd2f70b401481d05f034d8d0945)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.618541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.663457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7014ecd2f70b401481d05f034d8d0945', 'request_id': 'req-aaf39d68-fa66-405e-8109-6f808eda63ea'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.670585 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7014ecd2f70b401481d05f034d8d0945', 'request_id': 'req-aaf39d68-fa66-405e-8109-6f808eda63ea'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.676864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7014ecd2f70b401481d05f034d8d0945', 'request_id': 'req-aaf39d68-fa66-405e-8109-6f808eda63ea'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.687408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] The token cache is being invalidate because project 7014ecd2f70b401481d05f034d8d0945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:27.687692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.688316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aaf39d68-fa66-405e-8109-6f808eda63ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:27.689833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1265/2514] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:27 2022] DELETE /identity/v3/projects/7014ecd2f70b401481d05f034d8d0945 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:27.695700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.696591 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.696876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.715619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:27.716817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:27.773318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1250/2515] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:27.782484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.782659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.783034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.800835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:27.802047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:27.810433 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1266/2516] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:27.814477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:27.824616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7c57-76f3-4e5d-804f-a38076b58343 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.829087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.829730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.830008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.830309 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.831025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:27.831328 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.832914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.843913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1251/2517] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:27.847893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:27.856977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf54280-2264-4874-8fdc-7eedd651bacd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.863296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.863296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.863296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.863296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.863732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.865890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.892655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1267/2518] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:27 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:27.896688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:27.906502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec5b5e-00bd-4bad-b06f-70e4bee465e1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:27.936108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:27.963443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:27.964139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:27.964420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:27.964697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:27.965382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:27.967318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:27.986640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1252/2519] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:27 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:27.990950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.001659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc76b-2dc6-462c-b184-e23e9d9d0d99 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.007196 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.007846 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.008133 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.008420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.009147 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.010768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.021094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1268/2520] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:28.025176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.035190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada18e1-e040-4d14-a3b4-5e86f8b2e8ae admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.040339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.040993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.041292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.041551 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.042311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.043895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ea2c-8471-4f65-91b1-a2d3eb2013cd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.053771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1253/2521] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:05:28.058264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.067849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf93049-f86b-4a08-af3c-7209af7c3a69 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.072364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.073529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.073944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.074300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] PATH_INFO: `/v3/projects/fc0b0b92f08d475db2860fe87f8e276a/users/2213ea03e5dc4a94a407863f2f9700f4/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.088364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0b0b92f08d475db2860fe87f8e276a, user_id=2213ea03e5dc4a94a407863f2f9700f4, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.091021 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.103596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1269/2522] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:28 2022] PUT /identity/v3/projects/fc0b0b92f08d475db2860fe87f8e276a/users/2213ea03e5dc4a94a407863f2f9700f4/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:28.114645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.114936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.115211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.141193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] MFA Rules not processed for user `2213ea03e5dc4a94a407863f2f9700f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:28.142416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:28.204108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1254/2523] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:28.208460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.225372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:28.269967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6ba3-5638-4d5f-8865-8297859fb1f2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.275048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.275702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.275987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.276265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.276942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.278865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.303189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1270/2524] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:28 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:28.307183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.317564 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3183b0-a0d1-4b69-89d0-dccb68f165ab None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.371931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.372585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.372873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.373154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.374040 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.375993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.394368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1255/2525] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:28 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:28.398259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.408869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a23ec-3537-450c-ae1a-6f2d1f1c87d6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.413607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.414307 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.414590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.415466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.416188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.417760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.428533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1271/2526] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:28.432418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.442090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ddfe3-65ae-4548-a364-f093ddca2357 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.446648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.447520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.447807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.448083 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] PATH_INFO: `/v3/projects/ffecf67ee3394c3183def0dea4931e3f/users/d72926ca513b4b9da09eef0e60560baf/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.462933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffecf67ee3394c3183def0dea4931e3f, user_id=d72926ca513b4b9da09eef0e60560baf, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.465581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.478781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1256/2527] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:28 2022] PUT /identity/v3/projects/ffecf67ee3394c3183def0dea4931e3f/users/d72926ca513b4b9da09eef0e60560baf/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:28.482560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.492520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380694d-cba1-4607-98e4-633f4521b3b5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.548056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.548709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.548990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.549264 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.550005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.551671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f1f86-efc2-42d2-9738-4cf30ff67672 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.561099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1272/2528] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:28.565296 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.575520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0533c-73e1-4623-83d8-7b0355466bf4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.580027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.580930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.581210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.581484 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] PATH_INFO: `/v3/projects/ffecf67ee3394c3183def0dea4931e3f/users/d72926ca513b4b9da09eef0e60560baf/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.583481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffecf67ee3394c3183def0dea4931e3f, user_id=d72926ca513b4b9da09eef0e60560baf, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.586061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.588754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:28.598289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1257/2529] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:28 2022] PUT /identity/v3/projects/ffecf67ee3394c3183def0dea4931e3f/users/d72926ca513b4b9da09eef0e60560baf/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:28.609920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.610248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.610561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.637058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] MFA Rules not processed for user `d72926ca513b4b9da09eef0e60560baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:28.638353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:28.704875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1273/2530] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:28.716413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.718071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:28.773059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd1cf-c0cb-4959-9d26-0536b7948483 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.777140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.777767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.778048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.778349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.787096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.788501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.797730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1258/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:28.892950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:28.903220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290dd5-6493-42f8-b833-ad958636f128 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:28.906797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:28.907435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:28.907717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:28.907997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:28.916169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:28.965953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:28.967500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c22ab3-962d-4ac2-8971-3af168cf6078 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:28.976349 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1274/2532] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:31.522613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:31.582037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360124-6e9f-4531-a2c0-a7603cb04998 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:31.587013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:31.587874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:31.588152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:31.588422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] PATH_INFO: `/v3/users/2213ea03e5dc4a94a407863f2f9700f4` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:31.589593 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2213ea03e5dc4a94a407863f2f9700f4)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:31.591553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:31.636581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2213ea03e5dc4a94a407863f2f9700f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:31.643412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2213ea03e5dc4a94a407863f2f9700f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:31.644154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2213ea03e5dc4a94a407863f2f9700f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:31.651394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2213ea03e5dc4a94a407863f2f9700f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:31.662940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2213ea03e5dc4a94a407863f2f9700f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:31.669310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1259/2533] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:31 2022] DELETE /identity/v3/users/2213ea03e5dc4a94a407863f2f9700f4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:31.673764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:31.674258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:31.674378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:31.691213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:31.692425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:31.749744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1275/2534] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:31.759631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:31.761027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:31.780034 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:31.820633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22339-0149-42e2-882c-aadba879954c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:31.824752 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:31.825399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:31.825684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:31.825962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:31.835021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:31.837107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:31.846444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1260/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:32.106403 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:32.107830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:32.120219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f8f80-d24b-4d0b-a356-4ad5bb50f90b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:32.127135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:32.128007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:32.128276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:32.128656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] PATH_INFO: `/v3/projects/fc0b0b92f08d475db2860fe87f8e276a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:32.129730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0b0b92f08d475db2860fe87f8e276a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:32.131678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:32.178802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0b0b92f08d475db2860fe87f8e276a', 'request_id': 'req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.185977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0b0b92f08d475db2860fe87f8e276a', 'request_id': 'req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.192098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0b0b92f08d475db2860fe87f8e276a', 'request_id': 'req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.202066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] The token cache is being invalidate because project fc0b0b92f08d475db2860fe87f8e276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:32.202372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.202989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.204504 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1276/2536] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:32 2022] DELETE /identity/v3/projects/fc0b0b92f08d475db2860fe87f8e276a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:32.208415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:32.218511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541b1d-9788-475c-ba61-69c81caaf680 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:32.393254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:32.394028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:32.394336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:32.394609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] PATH_INFO: `/v3/users/d72926ca513b4b9da09eef0e60560baf` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:32.395773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72926ca513b4b9da09eef0e60560baf)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:32.397638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:32.442768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72926ca513b4b9da09eef0e60560baf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.449858 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72926ca513b4b9da09eef0e60560baf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.450489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72926ca513b4b9da09eef0e60560baf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.457195 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72926ca513b4b9da09eef0e60560baf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.469775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-13196475-c046-4e8d-af85-e57ad79f450b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72926ca513b4b9da09eef0e60560baf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.475583 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1261/2537] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:32 2022] DELETE /identity/v3/users/d72926ca513b4b9da09eef0e60560baf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:32.740221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:32.741678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:32.755798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e850-09b3-4537-8360-f4e49d2ca0ec admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:32.789677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:32.817577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:32.818475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:32.818757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:32.819029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] PATH_INFO: `/v3/projects/ffecf67ee3394c3183def0dea4931e3f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:32.820208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffecf67ee3394c3183def0dea4931e3f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:32.822771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:32.866655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffecf67ee3394c3183def0dea4931e3f', 'request_id': 'req-4bde3a0d-b95d-487a-80e3-476943911124'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.874095 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffecf67ee3394c3183def0dea4931e3f', 'request_id': 'req-4bde3a0d-b95d-487a-80e3-476943911124'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.880320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffecf67ee3394c3183def0dea4931e3f', 'request_id': 'req-4bde3a0d-b95d-487a-80e3-476943911124'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.891219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] The token cache is being invalidate because project ffecf67ee3394c3183def0dea4931e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:32.891510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.892139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4bde3a0d-b95d-487a-80e3-476943911124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:32.893706 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1277/2538] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:32 2022] DELETE /identity/v3/projects/ffecf67ee3394c3183def0dea4931e3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:32.898777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:32.899266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:32.899371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:32.916995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:32.918160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:32.949943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:32.982105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1262/2539] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:32.990162 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:32.990454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:32.990727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.010134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:33.011360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:33.019414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1278/2540] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:33.023660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.033179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96002-8025-402e-9fef-6bb509d9a7fc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.037656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.038329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.038612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.038886 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.039626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:33.039934 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.041509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.052651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1263/2541] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:33.057189 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.066432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5e173-69d3-4290-a4b9-3f16bc2716df None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.071697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.072346 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.072627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.072900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.073590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.075502 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.101061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1279/2542] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:33 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:33.105326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.115969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3968-d26e-4d81-a371-234abdbea7fc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.177245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.177851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.178170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.178447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.179129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.181667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.201103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1264/2543] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:33 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:33.205296 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.215534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e764-8a1f-41fb-a262-2c5795044aae admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.220199 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.220862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.221144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.221424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.222173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.223766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.235061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1280/2544] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:33.238958 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.250382 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55b2a6-950a-47ab-86fc-c49d5952c41c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.256522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.257253 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.257457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.257730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.258513 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.260105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249ab7-18f3-412d-ac9c-b59204ae568e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.270980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1265/2545] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:33.276202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.286987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31d2a-aad1-491f-a59d-9ad0ac439ae1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.292223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.293171 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.293518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.293858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] PATH_INFO: `/v3/projects/a1ca5db0b930420781f3f4add7b4f514/users/3c8973f41de54d83a3193b2cab1a4ae9/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.310090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ca5db0b930420781f3f4add7b4f514, user_id=3c8973f41de54d83a3193b2cab1a4ae9, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.312760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.333721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1281/2546] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:33 2022] PUT /identity/v3/projects/a1ca5db0b930420781f3f4add7b4f514/users/3c8973f41de54d83a3193b2cab1a4ae9/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:33.335430 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.335757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.336043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.365038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] MFA Rules not processed for user `3c8973f41de54d83a3193b2cab1a4ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:33.366412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:33.435789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1266/2547] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:33.447583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:33.449500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:33.506075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68553add-4152-411a-a754-c4b050af9eed admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:33.509817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:33.510497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:33.510784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:33.511060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:33.519566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:33.520976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:33.530194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1282/2548] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:43.432800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:43.526239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:46.329014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:46.330586 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:46.393010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637f72-6868-4bc3-a9c6-5dd258f1f354 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:46.402009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:46.402836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:46.403269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:46.403538 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:46.407211 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:46.486879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:46.488676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:46.516068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1267/2549] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:49.895657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:49.897672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:49.923832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8458a-f18a-4b85-923e-dd4061c884f3 service glance] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:49.928688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:49.929644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:49.930452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:49.930730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] PATH_INFO: `/v3/users/9af0007a1c904e16ab3eb9d0b240f92f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:49.931958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af0007a1c904e16ab3eb9d0b240f92f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:49.933894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:49.992951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af0007a1c904e16ab3eb9d0b240f92f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.001707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af0007a1c904e16ab3eb9d0b240f92f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.002498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af0007a1c904e16ab3eb9d0b240f92f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.012286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af0007a1c904e16ab3eb9d0b240f92f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.029574 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af0007a1c904e16ab3eb9d0b240f92f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.037855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1283/2550] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:49 2022] DELETE /identity/v3/users/9af0007a1c904e16ab3eb9d0b240f92f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:50.236938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.242377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.244082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:50.247816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684ad14-55ce-48f4-927c-361ed1432938 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.313166 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad22f-469d-4218-b4e4-39b28fe0a6a5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.316780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.317427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.317717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.317996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.319795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:50.320476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.321325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.321601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.321877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] PATH_INFO: `/v3/projects/85c50e21bba649adadfba9d276760e8b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.323156 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c50e21bba649adadfba9d276760e8b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.325031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.331728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.333164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc246632-9d9e-4323-8476-cf3450cedcfe service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.343814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1284/2551] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:05:50.370896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c50e21bba649adadfba9d276760e8b', 'request_id': 'req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.373413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:50.379553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c50e21bba649adadfba9d276760e8b', 'request_id': 'req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.386448 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c50e21bba649adadfba9d276760e8b', 'request_id': 'req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.397897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] The token cache is being invalidate because project 85c50e21bba649adadfba9d276760e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:50.398217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.399500 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9121bc5a-b21b-4ee4-b7b8-4fc89f113e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:50.401147 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1268/2552] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:50 2022] DELETE /identity/v3/projects/85c50e21bba649adadfba9d276760e8b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:50.406376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.406908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.407190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.425314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:50.426586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:50.486704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1285/2553] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:50.494431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.494721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.494995 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.512979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:50.514196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:50.522329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1269/2554] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:50.526970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.536676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422e341-3f9b-48cc-8187-d099649715e7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.541418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.542100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.542541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.542818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.543538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:50.543841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.545530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.561304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1286/2555] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:05:50.562588 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.572584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742868-83fb-4a8f-ac11-b2cea100b8b6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.577270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.578023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.578341 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.578637 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.579311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.581172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.607465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1270/2556] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:50 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:50.612003 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.617454 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:50.623736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80d5f-9a19-491f-b434-54abc281ef46 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.680528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.681200 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.681483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.681782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.682494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.684389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.704868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1287/2557] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:50 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:50.709004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.719550 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344826-485b-4660-aabb-61137b9926bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.724053 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.724719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.724996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.725270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.725999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.727615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.738130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1271/2558] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:50.742157 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.751989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a1a6-955c-4437-b528-db49bb53d8ef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.757010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.758304 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.758594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.758877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.759810 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.761414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e46d-744d-4b46-97bd-25de7a7baa1c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.772100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1288/2559] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:50.776836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.786706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165109-6e0c-415e-ae1d-0b10190e1080 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:50.791423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:50.792314 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.792594 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.792867 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] PATH_INFO: `/v3/projects/a2b07ff146d242bfb5bdfed68cb40e41/users/1053a959580e45d99b9c59c2fc16f4db/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.807787 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b07ff146d242bfb5bdfed68cb40e41, user_id=1053a959580e45d99b9c59c2fc16f4db, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:50.810435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:50.835350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1272/2560] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:50 2022] PUT /identity/v3/projects/a2b07ff146d242bfb5bdfed68cb40e41/users/1053a959580e45d99b9c59c2fc16f4db/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:50.837116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:50.837464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:50.837753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:50.864284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] MFA Rules not processed for user `1053a959580e45d99b9c59c2fc16f4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:50.865524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:50.933054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1289/2561] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:50.943446 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:50.945270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:51.021847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1476-20d6-4967-8cb0-d457ce3e5b25 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:51.027451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:51.028111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:51.028398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:51.028693 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:51.036614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:51.038217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612221-4638-49ff-81c4-147bd1f84272 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:51.047961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1273/2562] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:51.187099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:51.188812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:51.299269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fd5a8-194e-4b66-989e-19500feb6931 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:51.309218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:51.310825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:51.311311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:51.311721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] PATH_INFO: `/v3/users/3c8973f41de54d83a3193b2cab1a4ae9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:51.313441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8973f41de54d83a3193b2cab1a4ae9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:51.316113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:51.332043 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:51.396649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8973f41de54d83a3193b2cab1a4ae9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:51.411123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8973f41de54d83a3193b2cab1a4ae9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:51.413188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8973f41de54d83a3193b2cab1a4ae9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:51.431577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8973f41de54d83a3193b2cab1a4ae9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:51.458965 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8973f41de54d83a3193b2cab1a4ae9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:51.470248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1290/2563] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:51 2022] DELETE /identity/v3/users/3c8973f41de54d83a3193b2cab1a4ae9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:51.474595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:51.475077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:51.475209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:51.511087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:51.512684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:51.596662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1274/2564] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:51.607141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:51.614436 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:51.675032 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ac45-c6af-4065-b6f2-37f95a60e368 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:51.678647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:51.679283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:51.679596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:51.679870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:51.688951 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:51.690341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da569a3-3f27-4273-92a3-65d8101e4877 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:51.699803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1291/2565] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:51.997471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:51.998950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:52.007124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:52.019877 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917e68-cb6e-4ee2-94d7-bdfbbd34f0c3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.033663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.034765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.035657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.036044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] PATH_INFO: `/v3/projects/a1ca5db0b930420781f3f4add7b4f514` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.037959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ca5db0b930420781f3f4add7b4f514)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.040170 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.112783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ca5db0b930420781f3f4add7b4f514', 'request_id': 'req-d5024405-e9ab-4433-8af3-920782f1d5e5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:52.124970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ca5db0b930420781f3f4add7b4f514', 'request_id': 'req-d5024405-e9ab-4433-8af3-920782f1d5e5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:52.131847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ca5db0b930420781f3f4add7b4f514', 'request_id': 'req-d5024405-e9ab-4433-8af3-920782f1d5e5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:52.147636 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] The token cache is being invalidate because project a1ca5db0b930420781f3f4add7b4f514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:52.148930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:52.149780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5024405-e9ab-4433-8af3-920782f1d5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:52.151622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1275/2566] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:51 2022] DELETE /identity/v3/projects/a1ca5db0b930420781f3f4add7b4f514 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:52.156341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.156864 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.156975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.177767 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:52.179153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:52.249681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1292/2567] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:52.259069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.259390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.259630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.280189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:52.281512 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:52.292965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1276/2568] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:52.295068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.307141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97511c2-a963-49c4-9e5d-ec7d06fbc522 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.313226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.313981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.314309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.314692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.315633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:52.316016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.317680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.334644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1293/2569] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:52.335905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.346008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3655d-5e49-40d3-b183-c6fd90789184 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.351107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.351824 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.352105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.352376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.353060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.355046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.386518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1277/2570] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:52 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:52.390219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.401474 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a61d-f6c7-4b95-9d28-7c1cfe150f27 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.421657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:52.478756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.479437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.480056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.480337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.481173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.483797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.513265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1294/2571] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:52 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:52.515089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.527859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ff17-d726-415d-bea4-aa1900910061 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.532917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.533482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.533767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.534278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.534954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.536695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.548465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1278/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:52.557601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.572818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebd374-3f5f-4dad-9ea8-ce82d4455aeb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.578469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.579870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.579870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.579870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.580558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.582588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647fc1-101e-4059-ab21-f322f05256fa admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.596858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1295/2573] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:52.598221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.610009 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c155-2b77-492f-9a71-e618b6732e0a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.615271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.616167 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.616451 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.616725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] PATH_INFO: `/v3/projects/b272b59ce1f54270976d74492ba079d8/users/44e599900bb14d46ac7fb9de6db29751/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.634596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b272b59ce1f54270976d74492ba079d8, user_id=44e599900bb14d46ac7fb9de6db29751, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.637250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.652615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1279/2574] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:52 2022] PUT /identity/v3/projects/b272b59ce1f54270976d74492ba079d8/users/44e599900bb14d46ac7fb9de6db29751/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:52.663309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.663778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.664863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.694060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] MFA Rules not processed for user `44e599900bb14d46ac7fb9de6db29751`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:52.695383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:52.784156 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1296/2575] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:52.834240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:52.836394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:52.916845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637866-ab80-48c7-af8f-77e08b9d3407 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:52.921575 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:52.922267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:52.922689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:52.922972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:52.941753 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:52.943272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b1682-17b9-4721-be7e-90c5d18274e4 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:52.955092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1280/2576] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:52.972275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:53.044151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4aaf7-dba7-4915-828b-afd29c898fd1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:53.048929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:53.049802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.050084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.050391 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] PATH_INFO: `/v3/users/44e599900bb14d46ac7fb9de6db29751` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.051658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e599900bb14d46ac7fb9de6db29751)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:53.053641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:53.088440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:53.102848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e599900bb14d46ac7fb9de6db29751'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.110323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e599900bb14d46ac7fb9de6db29751'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.110982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e599900bb14d46ac7fb9de6db29751'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.119643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e599900bb14d46ac7fb9de6db29751'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.131587 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e599900bb14d46ac7fb9de6db29751'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.138068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1297/2577] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:52 2022] DELETE /identity/v3/users/44e599900bb14d46ac7fb9de6db29751 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:53.143028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.143319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.143612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.161250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:53.162522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.182675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:53.240407 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1281/2578] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:53.250769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:53.252345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.319460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627905c-1d81-4212-b775-e802e9e5de1f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:53.327298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:53.328152 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.328884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.328884 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.346355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:53.348046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:53.366445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1298/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:53.698526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:53.699979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.714087 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa4abc-0b4a-4f92-af11-1b6d573cceaf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:53.733281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:53.734241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.734833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.735116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] PATH_INFO: `/v3/projects/b272b59ce1f54270976d74492ba079d8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.736376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b272b59ce1f54270976d74492ba079d8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:53.738501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:53.759851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:53.761435 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.799667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b272b59ce1f54270976d74492ba079d8', 'request_id': 'req-93436a45-4d47-4150-ad61-0ddcf3bdb642'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.808996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b272b59ce1f54270976d74492ba079d8', 'request_id': 'req-93436a45-4d47-4150-ad61-0ddcf3bdb642'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.836193 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b272b59ce1f54270976d74492ba079d8', 'request_id': 'req-93436a45-4d47-4150-ad61-0ddcf3bdb642'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.851915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] The token cache is being invalidate because project b272b59ce1f54270976d74492ba079d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:53.852286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.853025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.855474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1282/2580] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:53 2022] DELETE /identity/v3/projects/b272b59ce1f54270976d74492ba079d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:53.858567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:53.858567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.888022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f55f7-a0c1-432d-99c8-fec48c10606d service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:53.924312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436a45-4d47-4150-ad61-0ddcf3bdb642 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:53.928960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:53.929869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.930216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.930481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] PATH_INFO: `/v3/users/d8d0bc370fee460ea78320b9e006da77` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.931739 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d0bc370fee460ea78320b9e006da77)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:53.933629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:53.942358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:53.955908 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:53.956568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.956853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.957125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.958981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:53.971483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:53.973317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d90a1f-90e1-4560-ad7e-22d97f5ff559 service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:53.985377 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1299/2581] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:53.986529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1efa0-be10-4cf7-b561-92dc59eed0fc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:53.986818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1efa0-be10-4cf7-b561-92dc59eed0fc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:53.987098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1efa0-be10-4cf7-b561-92dc59eed0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:53.989231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d0bc370fee460ea78320b9e006da77'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:53.992746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:54.002039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d0bc370fee460ea78320b9e006da77'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.002972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d0bc370fee460ea78320b9e006da77'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.008842 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d5b1efa0-be10-4cf7-b561-92dc59eed0fc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.010044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d5b1efa0-be10-4cf7-b561-92dc59eed0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.015143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d0bc370fee460ea78320b9e006da77'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.020215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1300/2582] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:54.028316 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.028617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.028901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.031350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d0bc370fee460ea78320b9e006da77'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.040980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1283/2583] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:53 2022] DELETE /identity/v3/users/d8d0bc370fee460ea78320b9e006da77 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:54.051827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.053135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.137337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1301/2584] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:54.142058 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.153862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7faa0d-bd2c-4a95-99a2-1562d505fbc3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.158531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.159196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.159486 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.159901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.160472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:54.160776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.162364 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.176418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1284/2585] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:54.180900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.190221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebadcb-405c-4fea-b652-e7bbf1ea157b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.195603 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.196273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.196557 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.196833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.197534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.199479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.225972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1302/2586] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:54.230222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.240057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debad6-8a35-429f-85c8-1591c787a5bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.268621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.270515 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.304907 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.305520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.305809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.306085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.306849 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.308789 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.329708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1285/2587] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:54.333677 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.343688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543e7b-3b8e-4486-b9a5-739d01b96f52 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.344652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260310-0753-4fd7-9e78-8be181bdf8fe admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.348654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.349175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.349376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.349617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.349898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.350002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.350325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.350598 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] PATH_INFO: `/v3/projects/58aa2c784d6e4dd1af993545f584a99e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.350700 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.351820 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58aa2c784d6e4dd1af993545f584a99e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.352722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.353805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.365363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1286/2588] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:05:54.366386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.375804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e50df-e12e-4f9c-aa65-6d28e042a722 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.380536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.381187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.381493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.381757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.383024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.384726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.395922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1287/2589] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:05:54.400590 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.403544 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58aa2c784d6e4dd1af993545f584a99e', 'request_id': 'req-53c3addf-8d6f-4654-a885-124143a2e24d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.411041 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a722a-6765-444d-b8cf-bc08e64352ba admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.411883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58aa2c784d6e4dd1af993545f584a99e', 'request_id': 'req-53c3addf-8d6f-4654-a885-124143a2e24d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.413208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:54.420969 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58aa2c784d6e4dd1af993545f584a99e', 'request_id': 'req-53c3addf-8d6f-4654-a885-124143a2e24d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.431832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] The token cache is being invalidate because project 58aa2c784d6e4dd1af993545f584a99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:54.432120 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.432792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53c3addf-8d6f-4654-a885-124143a2e24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:54.437777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1303/2590] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:54 2022] DELETE /identity/v3/projects/58aa2c784d6e4dd1af993545f584a99e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:54.439231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad538-6141-41f9-b106-ee0f3062169d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.439519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad538-6141-41f9-b106-ee0f3062169d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.439801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad538-6141-41f9-b106-ee0f3062169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.458521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5ffad538-6141-41f9-b106-ee0f3062169d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.459732 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5ffad538-6141-41f9-b106-ee0f3062169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.468252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.469149 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.469432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.469713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] PATH_INFO: `/v3/projects/23ff658fa875427286bbe89ed32dae4b/users/0b661af512234879bf4c056e92832dcd/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.492556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff658fa875427286bbe89ed32dae4b, user_id=0b661af512234879bf4c056e92832dcd, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.495225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87d996-8347-4146-8735-a8e92c96df99 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.509597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1288/2591] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:54 2022] PUT /identity/v3/projects/23ff658fa875427286bbe89ed32dae4b/users/0b661af512234879bf4c056e92832dcd/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:54.514895 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.515182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.515457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.521762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:54.531597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1304/2592] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:54.538344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.538344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.540053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.540348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.540823 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.560201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.561352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.602289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1289/2593] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:54.609631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.611443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.622947 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1305/2594] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:54.627337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.638634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1bcd-b6c0-4d73-aac2-4c3e0854c135 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.643552 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.644203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.644490 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.644792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.645509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:54.645814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.647447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.663759 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1306/2595] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:05:54.664751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.672271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c70101-5cc1-4291-810b-86e135eba551 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.674302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f08d00-39c3-4843-a1ad-d06e4a8c3ef1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.675855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.676504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.676784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.677057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.679963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.680593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.680877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.681172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.681880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.683801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.686574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.688003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.698173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1290/2596] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:54.711551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1307/2597] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:54.715479 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.726283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621f3-ae1f-4f74-8715-5b25edd10de3 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.782212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.782881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.783159 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.783432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.784106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.786015 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.810345 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1291/2598] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:54.811857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.824179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f310e6b-787d-4a81-aec1-535997b9199b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.829898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.830656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.831097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.831375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.832106 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.833747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.844749 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1308/2599] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:54.848800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.859059 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adb251-c5ba-489a-9353-a46d19eac72a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.864904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.865697 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.866303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.866746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.868057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.870004 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f16b9-4644-4d24-84f2-71bb9288b119 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.882017 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1292/2600] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:54.887165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:54.897890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f04236-99ea-4fc8-b5bb-c69b71008943 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:54.903437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:54.904479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.904795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.905071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] PATH_INFO: `/v3/projects/d9cc90b996f849e195b5dec39ec4dd37/users/dcc785c6b0bd4313bd6516f4fa21a142/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.920534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc90b996f849e195b5dec39ec4dd37, user_id=dcc785c6b0bd4313bd6516f4fa21a142, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:54.923215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:54.937219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1309/2601] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:54 2022] PUT /identity/v3/projects/d9cc90b996f849e195b5dec39ec4dd37/users/dcc785c6b0bd4313bd6516f4fa21a142/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:54.942224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746621-915b-47df-a48d-d570df177adc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:54.942522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746621-915b-47df-a48d-d570df177adc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:54.942802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746621-915b-47df-a48d-d570df177adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:54.961094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e9746621-915b-47df-a48d-d570df177adc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:54.962370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e9746621-915b-47df-a48d-d570df177adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:54.983939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:55.026634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1293/2602] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:55.036293 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:55.038354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:55.060548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:55.105590 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21491553-82fe-41e8-b97e-12411747b343 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:55.115088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:55.115857 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:55.116205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:55.116561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:55.127475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:55.128910 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:55.139843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1310/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:05:55.480598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af2e0-535f-4d2c-95c5-5f2518ff244e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:55.480970 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af2e0-535f-4d2c-95c5-5f2518ff244e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:55.481205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af2e0-535f-4d2c-95c5-5f2518ff244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:55.521539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2d9af2e0-535f-4d2c-95c5-5f2518ff244e None None] MFA Rules not processed for user `0b661af512234879bf4c056e92832dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:55.522910 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2d9af2e0-535f-4d2c-95c5-5f2518ff244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:55.614358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1294/2604] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:55.621621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:55.623907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:55.693813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff233dd-9615-4086-8566-1ca093589e2e service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:55.698251 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:55.698918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:55.699205 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:55.699489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:55.709431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:55.711573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:55.721322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1311/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:55.844106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:55.844629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:55.844629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:55.876471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] MFA Rules not processed for user `dcc785c6b0bd4313bd6516f4fa21a142`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:55.877685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:55.952878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1295/2606] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:55.956998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:55.969608 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0728598-fd85-4919-8e30-023ef0117d43 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:55.974607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:55.975272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:55.975554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:55.975832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:55.976748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:55.978592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.020424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1312/2607] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:55 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:56.024746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.036821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7003-4bc5-4dab-99d9-8ec2bf80dcbf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.092480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:56.106898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.107625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.107889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.108651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.109756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.112631 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.133967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1296/2608] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:56 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:56.138034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.148487 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b28f-118a-469a-a02c-6bae063214d1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.153002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.153662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.153942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.154243 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.154963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.156533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.167429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1313/2609] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:56.171453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.182207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdb246-2f53-42b2-b765-e9299cf085e6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.186827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.187722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.188001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.188274 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] PATH_INFO: `/v3/projects/c416b595d5f847d49cf8b1144a3219b7/users/1f467960db0e432c9fb521cab4be1c2a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.204076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416b595d5f847d49cf8b1144a3219b7, user_id=1f467960db0e432c9fb521cab4be1c2a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.206712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.219291 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1297/2610] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:56 2022] PUT /identity/v3/projects/c416b595d5f847d49cf8b1144a3219b7/users/1f467960db0e432c9fb521cab4be1c2a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:56.223250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.233139 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c52e-aa95-42b5-9552-0a00a794658e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.287221 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.287874 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.288178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.288441 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.289224 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.290833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.300297 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1314/2611] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:56.304880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.315707 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41116-3c01-4e98-94a5-b5dc7477d8d2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.320334 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.321214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.321499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.321779 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] PATH_INFO: `/v3/projects/c416b595d5f847d49cf8b1144a3219b7/users/1f467960db0e432c9fb521cab4be1c2a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.324105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416b595d5f847d49cf8b1144a3219b7, user_id=1f467960db0e432c9fb521cab4be1c2a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.326879 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48584d-319c-417e-93af-a95118a6d947 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.337347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1298/2612] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:56 2022] PUT /identity/v3/projects/c416b595d5f847d49cf8b1144a3219b7/users/1f467960db0e432c9fb521cab4be1c2a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:56.603088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.604811 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:56.619440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442254dd-3d4c-4445-af32-aa0f6f337531 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.642894 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:56.686851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.687748 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.688036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.688317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] PATH_INFO: `/v3/users/1053a959580e45d99b9c59c2fc16f4db` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.689540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1053a959580e45d99b9c59c2fc16f4db)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.691808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.758892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1053a959580e45d99b9c59c2fc16f4db'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:56.766783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1053a959580e45d99b9c59c2fc16f4db'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:56.767660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1053a959580e45d99b9c59c2fc16f4db'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:56.775664 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1053a959580e45d99b9c59c2fc16f4db'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:56.788432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1053a959580e45d99b9c59c2fc16f4db'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:56.795734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1315/2613] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:56 2022] DELETE /identity/v3/users/1053a959580e45d99b9c59c2fc16f4db => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:56.800388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50aea-cd20-4153-9c9e-985984796877 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.800756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50aea-cd20-4153-9c9e-985984796877 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.801109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d50aea-cd20-4153-9c9e-985984796877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.818485 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99d50aea-cd20-4153-9c9e-985984796877 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:56.819957 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99d50aea-cd20-4153-9c9e-985984796877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:56.879936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1299/2614] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:56.889956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:56.891666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:56.953358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6deb4-57c0-4bae-8e2e-cee9c35b084b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:56.957121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:56.957792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:56.958075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:56.958379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:56.968363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:56.969829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23babd-c198-4163-a06a-d46f38695144 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:56.980383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1316/2615] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:57.115828 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.116117 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.116398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.139023 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] MFA Rules not processed for user `0b661af512234879bf4c056e92832dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:57.140246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:57.215781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1300/2616] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:57.228607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb86f-b3c4-4ece-8dfe-45feeaea5b53 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.229014 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb86f-b3c4-4ece-8dfe-45feeaea5b53 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.229366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb86f-b3c4-4ece-8dfe-45feeaea5b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.294464 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b00bb86f-b3c4-4ece-8dfe-45feeaea5b53 None None] MFA Rules not processed for user `1f467960db0e432c9fb521cab4be1c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:57.295998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b00bb86f-b3c4-4ece-8dfe-45feeaea5b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:57.309603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.311224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:57.326224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16c94-1474-4410-8fc7-65ff39b14f9d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.332205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.333185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.333542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.333888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] PATH_INFO: `/v3/projects/a2b07ff146d242bfb5bdfed68cb40e41` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.335318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b07ff146d242bfb5bdfed68cb40e41)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.337381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.343653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:57.389119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:57.399932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b07ff146d242bfb5bdfed68cb40e41', 'request_id': 'req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:57.411216 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b07ff146d242bfb5bdfed68cb40e41', 'request_id': 'req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:57.417869 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1317/2617] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:57.420342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b07ff146d242bfb5bdfed68cb40e41', 'request_id': 'req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:57.443154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] The token cache is being invalidate because project a2b07ff146d242bfb5bdfed68cb40e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:57.443466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:57.444721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-27bfcbb0-babe-45b4-ab95-2b3d48126b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:57.447234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1301/2618] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:57 2022] DELETE /identity/v3/projects/a2b07ff146d242bfb5bdfed68cb40e41 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:57.453288 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.453581 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.453863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.478034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:57.479352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:57.574761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1318/2619] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:57.583601 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.584372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.584372 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.610850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:57.612626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:57.625420 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1302/2620] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:57.629744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.641299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58aa82-fe53-4b48-a81a-a14694d05a19 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.646384 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.647066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.647348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.647620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.648871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:57.649425 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.650792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.664277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1319/2621] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:57.668731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.678019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c46f99-6ba9-427c-aba3-983023c4d38a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.683277 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.683990 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.684273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.684544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.685233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.687179 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.722653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1303/2622] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:57.727744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.740520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a36b5-db95-41bd-aa46-1f2da3981472 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.806523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.807286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.807656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.808018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.808885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.810942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.837583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1320/2623] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:57 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:57.838948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.850600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3ee-a4ea-4eb1-8db1-0fb123d2a15d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.861585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.862321 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.862611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.862890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.863774 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.865549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.884442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1304/2624] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:57.887990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.903991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcf94-edfe-405d-b5f5-544b63b79af1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.909658 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.910565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.910825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.911075 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:57.912090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:57.914378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30087db-4182-4c97-8b11-5b830866f472 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:57.928812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1321/2625] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:57.933289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:57.949902 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bec37-4b2c-43b4-b0c2-fe78bb44db6f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:57.966823 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:57.972973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:57.973261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:57.975007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] PATH_INFO: `/v3/projects/7b27ce25b87c4de5bebb2617192c183b/users/92b905a8fcd748a79f03214ee57f7364/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.004217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b27ce25b87c4de5bebb2617192c183b, user_id=92b905a8fcd748a79f03214ee57f7364, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.007128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.026329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1305/2626] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:57 2022] PUT /identity/v3/projects/7b27ce25b87c4de5bebb2617192c183b/users/92b905a8fcd748a79f03214ee57f7364/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:58.038367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.039621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.039917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.073358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] MFA Rules not processed for user `92b905a8fcd748a79f03214ee57f7364`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:58.074756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:58.105887 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:58.165561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1322/2627] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:58.169918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.239630 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccab75f-67ed-4526-a717-b1e5945ea53b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.244131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.244868 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.245226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.245552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.246351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.248469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.284854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1306/2628] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:58 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:05:58.289685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.303972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a743c6e-a255-4eba-9f23-26f334eca56d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.376356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.377320 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.377601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.377875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.378631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.380500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.404702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1323/2629] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:05:58 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:05:58.408518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.420391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942190-7fb1-4918-bb9c-c1c301daef57 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.425846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.427105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.427398 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.427680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.428440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.430745 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.443545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1307/2630] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:58.447923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.458536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95fe2e-48a2-42e0-906b-13020b1fcd39 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.464751 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.465717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.466010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.466319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] PATH_INFO: `/v3/projects/f712fe9fee634010af5c9fd24b6cff3c/users/69a9acc29f3940a8b2b097d156fda56a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.483809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f712fe9fee634010af5c9fd24b6cff3c, user_id=69a9acc29f3940a8b2b097d156fda56a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.486429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.501653 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1324/2631] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:58 2022] PUT /identity/v3/projects/f712fe9fee634010af5c9fd24b6cff3c/users/69a9acc29f3940a8b2b097d156fda56a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:58.505370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.517525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ed4ae-7729-4233-a2d6-98d40a9745b4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.556459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:58.584128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.584803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.585086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.585417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.586225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.587847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.601386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1308/2632] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:05:58.604927 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.616460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5549f-7117-4049-8f0f-210a21fb2fd1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.624543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.625226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.625488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.625825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.626104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] PATH_INFO: `/v3/projects/f712fe9fee634010af5c9fd24b6cff3c/users/69a9acc29f3940a8b2b097d156fda56a/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.627396 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:58.628333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f712fe9fee634010af5c9fd24b6cff3c, user_id=69a9acc29f3940a8b2b097d156fda56a, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.631178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a6c43-dc8a-4b85-af8e-7772cabe2834 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.641781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262436-a050-4227-a43a-6c413230a85c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.643620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1325/2633] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:05:58 2022] PUT /identity/v3/projects/f712fe9fee634010af5c9fd24b6cff3c/users/69a9acc29f3940a8b2b097d156fda56a/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:58.654973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.655604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.655604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.682321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] MFA Rules not processed for user `69a9acc29f3940a8b2b097d156fda56a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:58.683530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:58.699737 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.700615 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.700930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.701205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] PATH_INFO: `/v3/users/dcc785c6b0bd4313bd6516f4fa21a142` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.702463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc785c6b0bd4313bd6516f4fa21a142)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:58.704405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:58.750227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc785c6b0bd4313bd6516f4fa21a142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:58.756151 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1326/2634] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:05:58.759606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc785c6b0bd4313bd6516f4fa21a142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:58.760359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc785c6b0bd4313bd6516f4fa21a142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:58.768431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:58.768666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc785c6b0bd4313bd6516f4fa21a142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:58.770145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:58.777682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:58.785763 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc785c6b0bd4313bd6516f4fa21a142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:58.792423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1309/2635] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:58 2022] DELETE /identity/v3/users/dcc785c6b0bd4313bd6516f4fa21a142 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:05:58.838718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aaa2d-56b1-4ebc-b278-bd235b41f436 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:58.906342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:58.907078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:58.907468 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:58.907859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:58.910354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.033089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.036232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.048672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.050096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.053255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1327/2636] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:05:59.146428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:59.158627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.159280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a3ef9-fb6d-4514-9a3f-4000a09f15c3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.160742 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.165165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.166295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.166644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.166985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] PATH_INFO: `/v3/projects/d9cc90b996f849e195b5dec39ec4dd37` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.168298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cc90b996f849e195b5dec39ec4dd37)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.170287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.176071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97898ab3-e202-421f-a5ca-650a15d277fb service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.180618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.181446 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.182017 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.182521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.184496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.228960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cc90b996f849e195b5dec39ec4dd37', 'request_id': 'req-cec903b6-dcc1-4812-ba81-d7a7b3e72511'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.242459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cc90b996f849e195b5dec39ec4dd37', 'request_id': 'req-cec903b6-dcc1-4812-ba81-d7a7b3e72511'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.249417 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cc90b996f849e195b5dec39ec4dd37', 'request_id': 'req-cec903b6-dcc1-4812-ba81-d7a7b3e72511'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.255853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.257424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.261725 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] The token cache is being invalidate because project d9cc90b996f849e195b5dec39ec4dd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:59.262085 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.263151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.268081 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1310/2637] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:59 2022] DELETE /identity/v3/projects/d9cc90b996f849e195b5dec39ec4dd37 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:59.268386 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1328/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:05:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:05:59.269310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.270788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.352982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec903b6-dcc1-4812-ba81-d7a7b3e72511 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.359148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.360278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.360579 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.360915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] PATH_INFO: `/v3/users/1f467960db0e432c9fb521cab4be1c2a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.362347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f467960db0e432c9fb521cab4be1c2a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.364815 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.430688 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f467960db0e432c9fb521cab4be1c2a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.438903 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f467960db0e432c9fb521cab4be1c2a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.439533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f467960db0e432c9fb521cab4be1c2a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.447635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f467960db0e432c9fb521cab4be1c2a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.462365 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-715830ad-e3da-4b15-bbc3-3c6af85d46d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f467960db0e432c9fb521cab4be1c2a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.468911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1311/2639] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:05:59 2022] DELETE /identity/v3/users/1f467960db0e432c9fb521cab4be1c2a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:59.646638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.668392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed955b4-a626-4ea5-91b1-b413337efb88 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.674281 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:59.727066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.727945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.728213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.728481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] PATH_INFO: `/v3/projects/c416b595d5f847d49cf8b1144a3219b7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.729665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c416b595d5f847d49cf8b1144a3219b7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.731606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.778671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c416b595d5f847d49cf8b1144a3219b7', 'request_id': 'req-449707fc-0155-4916-9e28-3cfd767c16a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.786284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c416b595d5f847d49cf8b1144a3219b7', 'request_id': 'req-449707fc-0155-4916-9e28-3cfd767c16a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.793579 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c416b595d5f847d49cf8b1144a3219b7', 'request_id': 'req-449707fc-0155-4916-9e28-3cfd767c16a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.805694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] The token cache is being invalidate because project c416b595d5f847d49cf8b1144a3219b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:05:59.805981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.806702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-449707fc-0155-4916-9e28-3cfd767c16a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:05:59.808300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1329/2640] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:05:59 2022] DELETE /identity/v3/projects/c416b595d5f847d49cf8b1144a3219b7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:05:59.813210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.813497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.813773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.824279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:05:59.835354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:59.838310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.897800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1312/2641] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:59.906226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.906516 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.906795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.925459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:05:59.926729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:05:59.938146 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1330/2642] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:05:59.939544 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.949158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe866a9-a42c-41db-afa3-36312869c7bc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.953795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.954476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.954759 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.955035 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.955896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:05:59.956204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.957794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:05:59.970819 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1313/2643] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:05:59.975757 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:05:59.986414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aab11-e679-4a95-9798-0d46cc86334d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:05:59.992451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:05:59.993131 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:05:59.993424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:05:59.993703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:05:59.994456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:05:59.998023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.029692 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1331/2644] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:05:59 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:00.030857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.041655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c5ee-7416-4e04-949e-821610efaf59 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.101794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.102710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.102939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.103278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.103864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.106245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.131562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1314/2645] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:00 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:00.133990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.145448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190cb1c-0bd0-4de1-9175-56bdd9a65341 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.155292 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.156227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.156613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.156994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.157834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.159586 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.174981 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1332/2646] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:00.176851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.187239 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a907-47d5-49d6-9db7-ab37f29c6d8f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.194453 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.195735 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.196028 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.196306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.197039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.198695 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8871416-10d2-46a2-acc4-b8c0d47b548c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.210098 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1315/2647] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:00.214828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.225888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386c40-a68d-42f7-bdc5-b64a86ff8eea admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.232641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.233602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.233980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.238333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] PATH_INFO: `/v3/projects/abd1953437014806bd33111f605609e5/users/18349542920844079180fbf4e99776b3/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.259809 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd1953437014806bd33111f605609e5, user_id=18349542920844079180fbf4e99776b3, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.263665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.283952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1333/2648] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:00 2022] PUT /identity/v3/projects/abd1953437014806bd33111f605609e5/users/18349542920844079180fbf4e99776b3/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:00.295092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87408-2427-4927-b6de-61ae375de1be None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.295412 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87408-2427-4927-b6de-61ae375de1be None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.300371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87408-2427-4927-b6de-61ae375de1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.337896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-89d87408-2427-4927-b6de-61ae375de1be None None] MFA Rules not processed for user `18349542920844079180fbf4e99776b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:00.339339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-89d87408-2427-4927-b6de-61ae375de1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:00.397080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:00.404026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1316/2649] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:00.408537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.452416 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:00.487893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b56e-d31d-4e40-b8ac-1e86204116ce admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.493274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.494060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.494476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.494859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.495681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.497736 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.529013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1334/2650] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:00 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:00.532653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d87408-2427-4927-b6de-61ae375de1be None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.544225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d87408-2427-4927-b6de-61ae375de1be None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.611383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.612080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.612406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.612951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.613444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.615383 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.638943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1317/2651] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:00 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:00.642877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.654984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994bf9f-95a2-42c5-8a47-5f34f3255ea3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.660701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.661373 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.661661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.661939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.662718 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.664469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.675577 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1335/2652] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:00.680505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.691722 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff7c0-b134-438d-9085-b65ca7c172f5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.697257 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.698415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.699268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.699556 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] PATH_INFO: `/v3/projects/1d3514086c4040208a941587a8b57c4b/users/e99bf69f2b0f4508b07f1fbfdac02362/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.719390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3514086c4040208a941587a8b57c4b, user_id=e99bf69f2b0f4508b07f1fbfdac02362, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.723144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.736829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1318/2653] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:00 2022] PUT /identity/v3/projects/1d3514086c4040208a941587a8b57c4b/users/e99bf69f2b0f4508b07f1fbfdac02362/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:00.740671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.751978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d3e6-e3f8-4cad-8f40-3fa5aecf0e65 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.819677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.821170 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.821730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.822148 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.822933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.824792 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7078cd-a550-47f6-a865-5d6f558f8564 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.838175 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1336/2654] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:00.842042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:00.854310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d92a-cb1b-4fd8-b929-aa3f49fc6835 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:00.861152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:00.862165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.862634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.862855 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] PATH_INFO: `/v3/projects/1d3514086c4040208a941587a8b57c4b/users/e99bf69f2b0f4508b07f1fbfdac02362/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.870197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3514086c4040208a941587a8b57c4b, user_id=e99bf69f2b0f4508b07f1fbfdac02362, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:00.872843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:00.884517 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1319/2655] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:00 2022] PUT /identity/v3/projects/1d3514086c4040208a941587a8b57c4b/users/e99bf69f2b0f4508b07f1fbfdac02362/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:00.895970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:00.896272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:00.896555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:00.922916 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] MFA Rules not processed for user `e99bf69f2b0f4508b07f1fbfdac02362`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:00.924116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:00.991101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1337/2656] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:01.002850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:01.004496 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:01.061541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386277cf-8726-46a8-acbb-20f21c8f2594 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:01.065202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:01.065835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:01.066137 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:01.066428 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:01.121777 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:01.123241 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:01.132164 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1320/2657] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:02.475950 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:02.486006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c9f56-3b3e-4d1f-84f3-bcac0302b095 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:02.489567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:02.490240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:02.490534 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:02.490814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:02.500885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:02.502345 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd4847-9af3-4b0b-8106-92ae87a4c269 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:02.512606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1338/2658] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:06.414648 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:06.420717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:06.486026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d938965-8e57-44ca-ae53-1b1acdfd2093 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:06.490836 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:06.491696 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:06.491978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:06.492281 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] PATH_INFO: `/v3/users/18349542920844079180fbf4e99776b3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:06.494751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18349542920844079180fbf4e99776b3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:06.495972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:06.552712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18349542920844079180fbf4e99776b3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:06.561027 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18349542920844079180fbf4e99776b3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:06.561687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18349542920844079180fbf4e99776b3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:06.568778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18349542920844079180fbf4e99776b3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:06.585569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18349542920844079180fbf4e99776b3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:06.591549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1321/2659] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:06 2022] DELETE /identity/v3/users/18349542920844079180fbf4e99776b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:06.595933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:06.596390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:06.596536 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:06.614330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:06.615568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:06.628922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:06.677424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1339/2660] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:06.687516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:06.688901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:06.743838 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892751e-772e-4987-b9b0-57b0ca2835b0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:06.747443 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:06.748074 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:06.748350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:06.748618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:06.757618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:06.759655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:06.769123 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1322/2661] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:07.034708 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:07.036393 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:07.052412 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a0c96-41d9-4f69-8232-825202a4ba7f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:07.057575 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:07.058493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.058782 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.059089 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] PATH_INFO: `/v3/projects/abd1953437014806bd33111f605609e5` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.060353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd1953437014806bd33111f605609e5)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:07.062272 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:07.108530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd1953437014806bd33111f605609e5', 'request_id': 'req-e1c3be85-0f56-432b-b442-b209b8fbb7a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.115323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd1953437014806bd33111f605609e5', 'request_id': 'req-e1c3be85-0f56-432b-b442-b209b8fbb7a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.122033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd1953437014806bd33111f605609e5', 'request_id': 'req-e1c3be85-0f56-432b-b442-b209b8fbb7a3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.133744 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] The token cache is being invalidate because project abd1953437014806bd33111f605609e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:07.134027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.134695 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.136256 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1340/2662] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:07 2022] DELETE /identity/v3/projects/abd1953437014806bd33111f605609e5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:07.140401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:07.150014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352b004-b25b-4b45-91a7-641df04cd825 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:07.173129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:07.206445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:07.207303 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.207581 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.207850 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] PATH_INFO: `/v3/users/e99bf69f2b0f4508b07f1fbfdac02362` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.209022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99bf69f2b0f4508b07f1fbfdac02362)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:07.211584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:07.255359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99bf69f2b0f4508b07f1fbfdac02362'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.263627 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99bf69f2b0f4508b07f1fbfdac02362'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.264519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99bf69f2b0f4508b07f1fbfdac02362'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.272818 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99bf69f2b0f4508b07f1fbfdac02362'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.286240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a760f3e5-4093-423f-9045-c8104323d0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99bf69f2b0f4508b07f1fbfdac02362'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.292237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1323/2663] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:07 2022] DELETE /identity/v3/users/e99bf69f2b0f4508b07f1fbfdac02362 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:07.572452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:07.573945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:07.597129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3be85-0f56-432b-b442-b209b8fbb7a3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:07.657919 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:07.658833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.659116 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.659394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] PATH_INFO: `/v3/projects/1d3514086c4040208a941587a8b57c4b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.660644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3514086c4040208a941587a8b57c4b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:07.662604 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:07.720263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:07.725511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3514086c4040208a941587a8b57c4b', 'request_id': 'req-5e454188-8b4d-41d2-b352-df9967413972'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.737104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3514086c4040208a941587a8b57c4b', 'request_id': 'req-5e454188-8b4d-41d2-b352-df9967413972'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.746645 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3514086c4040208a941587a8b57c4b', 'request_id': 'req-5e454188-8b4d-41d2-b352-df9967413972'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.758529 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] The token cache is being invalidate because project 1d3514086c4040208a941587a8b57c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:07.758930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.759753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5e454188-8b4d-41d2-b352-df9967413972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:07.766531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1341/2664] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:07 2022] DELETE /identity/v3/projects/1d3514086c4040208a941587a8b57c4b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:07.768086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.768562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.768562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.791942 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:07.793189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:07.856548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1324/2665] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:07.866330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.866568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.866801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.887702 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:07.888923 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:07.897851 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1342/2666] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:07.902472 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:07.915349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299bd12-5383-4d6f-82a9-802a5ddc2937 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:07.921967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:07.922754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.923102 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.923507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.924600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:07.924807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:07.926506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:07.939492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1325/2667] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:07.943805 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:07.955940 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89b7d7-646b-4088-8b14-63841a77676e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:07.960982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:07.961649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:07.961939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:07.962254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:07.962963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:07.965098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:07.994308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1343/2668] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:07 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:07.997526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.010520 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec1ac-a055-45d9-bbd4-443f9706cd14 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.048143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:08.079563 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.080258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.080542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.080826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.081508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.083413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.107411 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1326/2669] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:07 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:08.111830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.123459 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d392-b443-446c-9cbb-ab2332c52dd8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.128880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.129548 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.129831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.130101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.130855 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.132896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.145699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1344/2670] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:08.150780 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.160619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe10-e492-4aa0-be5a-cde8c92099be admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.166076 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.167151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.167432 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.167705 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.168427 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.170006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3d6ec-4485-4aa8-90fa-92f049457480 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.181984 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1327/2671] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:08.185467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.196638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7568-10d6-465a-bdde-5860b20c1bd4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.201541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.202634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.202918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.203190 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] PATH_INFO: `/v3/projects/a46e7c4bb8f24f038fadb71b39cc3aca/users/e4f9689754d043b0a5e812705155aad0/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.218686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46e7c4bb8f24f038fadb71b39cc3aca, user_id=e4f9689754d043b0a5e812705155aad0, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.221396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.237973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1345/2672] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:08 2022] PUT /identity/v3/projects/a46e7c4bb8f24f038fadb71b39cc3aca/users/e4f9689754d043b0a5e812705155aad0/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:08.250183 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.250478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.250772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.279262 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] MFA Rules not processed for user `e4f9689754d043b0a5e812705155aad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:08.280473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:08.350022 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1328/2673] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:08.354545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.419902 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a828-ce5c-4f42-b91c-eea6779fe229 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.424540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.425202 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.425491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.425774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.426524 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.428419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.454303 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1346/2674] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:08 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:08.457873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.469089 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5cb2b-1090-4b21-a2ad-5306c0ca81e9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.524406 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.525073 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.525359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.525638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.526356 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.528264 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.547163 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1329/2675] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:08 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:08.551074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.561363 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593796a-a9a5-400b-9226-0fb6cf4ef82b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.565987 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.566689 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.566976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.567511 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.567972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.569789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.581437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1347/2676] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:08.585569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.596095 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152b9c-115b-49bd-b472-ddc53ad3fe72 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.600690 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.601561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.601840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.602138 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] PATH_INFO: `/v3/projects/31246098c29e48b083a7aa628a292c00/users/5fde45bf66fd4c038a5e495f1a91fa55/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.616633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31246098c29e48b083a7aa628a292c00, user_id=5fde45bf66fd4c038a5e495f1a91fa55, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.619344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.631491 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1330/2677] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:08 2022] PUT /identity/v3/projects/31246098c29e48b083a7aa628a292c00/users/5fde45bf66fd4c038a5e495f1a91fa55/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:08.636068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.646220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e60728-59eb-47e8-a61b-aa710241987b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.684528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:08.702578 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.703240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.703522 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.703797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.704560 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.706086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede89349-3045-4090-9d2c-77895bbe3a41 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.716457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1348/2678] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:08.720616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.730685 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a18d-f684-4d02-b5a9-5ed9483acf31 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.735390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.736271 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.736548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.736821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] PATH_INFO: `/v3/projects/31246098c29e48b083a7aa628a292c00/users/5fde45bf66fd4c038a5e495f1a91fa55/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.738806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31246098c29e48b083a7aa628a292c00, user_id=5fde45bf66fd4c038a5e495f1a91fa55, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.741463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.743731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:08.752900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1331/2679] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:08 2022] PUT /identity/v3/projects/31246098c29e48b083a7aa628a292c00/users/5fde45bf66fd4c038a5e495f1a91fa55/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:08.763313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.763602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.763880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.789753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] MFA Rules not processed for user `5fde45bf66fd4c038a5e495f1a91fa55`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:08.790980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:08.858726 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1349/2680] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:08.870488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:08.872297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:08.928114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a8e9-939a-4ec4-b3ab-daa150be8544 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:08.932235 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:08.932869 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:08.933153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:08.933429 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:08.942488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:08.943900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965fe1b-5914-4fd1-9e31-aa3793405b23 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:08.953837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1332/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:09.035519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:09.043643 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ade03-e7f2-4816-adda-b319bc94c6ea None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:09.047423 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:09.048068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:09.048351 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:09.048624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:09.114064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:09.115591 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:09.125448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1350/2682] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:10.781265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b6e5f-3bed-4eb7-ae80-a198c534ced6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:10.781772 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b6e5f-3bed-4eb7-ae80-a198c534ced6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:10.781899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b6e5f-3bed-4eb7-ae80-a198c534ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:10.799769 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-101b6e5f-3bed-4eb7-ae80-a198c534ced6 None None] MFA Rules not processed for user `0b661af512234879bf4c056e92832dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:10.801252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-101b6e5f-3bed-4eb7-ae80-a198c534ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:10.857487 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1333/2683] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:13.961707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:14.027254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c106e-28ee-4f3e-9c20-3e0d335369e5 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:14.031844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:14.032723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:14.033005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:14.033280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] PATH_INFO: `/v3/users/e4f9689754d043b0a5e812705155aad0` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:14.034644 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f9689754d043b0a5e812705155aad0)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:14.036600 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:14.039567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:14.082160 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f9689754d043b0a5e812705155aad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.089492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f9689754d043b0a5e812705155aad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.090125 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f9689754d043b0a5e812705155aad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.096967 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f9689754d043b0a5e812705155aad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.109223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f9689754d043b0a5e812705155aad0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.115260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1351/2684] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:13 2022] DELETE /identity/v3/users/e4f9689754d043b0a5e812705155aad0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:14.119866 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:14.120323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:14.120422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:14.137801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:14.139021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:14.195536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1334/2685] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:14.205481 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:14.206922 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:14.266681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452ec8c-ca6d-4e93-9b81-bd20295a777f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:14.270385 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:14.271036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:14.271315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:14.271712 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:14.281332 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:14.282789 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:14.293061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1352/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:14.555263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:14.557080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:14.569488 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57c0-6b4e-4aed-8e1d-611d906cd47d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:14.574859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:14.575776 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:14.576056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:14.576330 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] PATH_INFO: `/v3/projects/a46e7c4bb8f24f038fadb71b39cc3aca` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:14.577894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46e7c4bb8f24f038fadb71b39cc3aca)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:14.579444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:14.617932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:14.627889 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46e7c4bb8f24f038fadb71b39cc3aca', 'request_id': 'req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.635562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46e7c4bb8f24f038fadb71b39cc3aca', 'request_id': 'req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.641234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46e7c4bb8f24f038fadb71b39cc3aca', 'request_id': 'req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.652387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] The token cache is being invalidate because project a46e7c4bb8f24f038fadb71b39cc3aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:14.652667 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.653306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.654844 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1335/2687] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:14 2022] DELETE /identity/v3/projects/a46e7c4bb8f24f038fadb71b39cc3aca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:14.658935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:14.668507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d593e5-eb13-4eba-853b-5ab1c9f54c00 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:14.723212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:14.724110 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:14.724396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:14.724670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] PATH_INFO: `/v3/users/5fde45bf66fd4c038a5e495f1a91fa55` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:14.725856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fde45bf66fd4c038a5e495f1a91fa55)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:14.727975 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:14.756609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:14.778834 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fde45bf66fd4c038a5e495f1a91fa55'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.786001 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fde45bf66fd4c038a5e495f1a91fa55'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.786626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fde45bf66fd4c038a5e495f1a91fa55'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.793545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fde45bf66fd4c038a5e495f1a91fa55'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.805113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ec76a1df-e872-40fd-aa76-f3c3abf8948a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fde45bf66fd4c038a5e495f1a91fa55'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:14.812413 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1353/2688] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:14 2022] DELETE /identity/v3/users/5fde45bf66fd4c038a5e495f1a91fa55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:15.126794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.128311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:15.142653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8e7e-6109-42e8-bdcd-4d5c3b0c48de admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.201413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.202316 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.202604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.202883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] PATH_INFO: `/v3/projects/31246098c29e48b083a7aa628a292c00` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.204135 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31246098c29e48b083a7aa628a292c00)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.206019 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.250368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31246098c29e48b083a7aa628a292c00', 'request_id': 'req-b4e29788-4648-49a2-b4a8-991bf966e1f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:15.257307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31246098c29e48b083a7aa628a292c00', 'request_id': 'req-b4e29788-4648-49a2-b4a8-991bf966e1f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:15.263270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31246098c29e48b083a7aa628a292c00', 'request_id': 'req-b4e29788-4648-49a2-b4a8-991bf966e1f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:15.274050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] The token cache is being invalidate because project 31246098c29e48b083a7aa628a292c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:15.274369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:15.275548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b4e29788-4648-49a2-b4a8-991bf966e1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:15.277054 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1336/2689] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:15 2022] DELETE /identity/v3/projects/31246098c29e48b083a7aa628a292c00 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:15.281945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.282408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.282523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.300648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:15.301843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:15.365263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1354/2690] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:15.367226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.367523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.367845 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.386674 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:15.387917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:15.396297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1337/2691] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:15.400543 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.410520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c7a3c-c87d-41a4-a290-e67c251499c5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.415731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.416398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.416685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.416962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.417690 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:15.417997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.419619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.431896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1355/2692] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:15.436618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.446870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f48268-deb1-4a33-82d7-c1bc80cc49ef None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.451982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.452639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.452980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.453177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.453854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.455765 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.483462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1338/2693] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:15.487953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.499223 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f05a4-92f5-43ee-ae28-3c21ebb934d7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.554246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.554907 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.555191 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.555469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.556277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.558178 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.577053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1356/2694] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:15.581112 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.591701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c2d9-c5cc-4c4a-ba53-673c16f38a71 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.597065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.597702 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.597983 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.598290 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.599008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.600574 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.612114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1339/2695] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:15.615946 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.626065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239bafc-01d9-4f01-a8c8-013ff596fdb1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.630666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.631321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.631609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.631890 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.632614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.634350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96a1b-e741-495f-8ae3-d45c1c797807 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.644596 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1357/2696] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:15.648577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.658977 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94949b2-d64a-4058-8db2-5b1e1540e00a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.663604 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.664509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.664794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.665071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] PATH_INFO: `/v3/projects/e4b2b77121e24c2f846c053be97217bb/users/4c7486aa937f4418bc080e4f4a4dacb2/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.677332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:15.680691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b2b77121e24c2f846c053be97217bb, user_id=4c7486aa937f4418bc080e4f4a4dacb2, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.683516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.698414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1340/2697] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:15 2022] PUT /identity/v3/projects/e4b2b77121e24c2f846c053be97217bb/users/4c7486aa937f4418bc080e4f4a4dacb2/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:15.709533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.709821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.710100 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.729073 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:15.744253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] MFA Rules not processed for user `4c7486aa937f4418bc080e4f4a4dacb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:15.745538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:15.808027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1358/2698] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:15.812413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.872032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4a1a4-f2ba-4c6a-b8dd-240445cf27be admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.876659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.877306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.877596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.877870 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.878651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.880522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:15.905619 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1341/2699] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:15.909573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:15.920161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725559e-0bd8-4c62-bd2e-ea35f041984a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:15.975994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:15.976660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:15.976948 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:15.977227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:15.978564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:15.980491 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.001449 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1359/2700] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:15 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:16.005405 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:16.018719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f2a46-b533-49ce-aaab-c745fb6f2e17 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:16.023514 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:16.025778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.026065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.026371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.027113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:16.029541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.045209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1342/2701] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:16.049172 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:16.059995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b185-1c5b-45af-ab55-10bd60bbed57 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:16.064693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:16.065592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.065906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.066215 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] PATH_INFO: `/v3/projects/71ff134442e5414fa957b0fe4156a714/users/b81eff426c46414eb3c4a4b4eb155252/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.087145 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ff134442e5414fa957b0fe4156a714, user_id=b81eff426c46414eb3c4a4b4eb155252, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:16.090832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.113381 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1360/2702] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:16 2022] PUT /identity/v3/projects/71ff134442e5414fa957b0fe4156a714/users/b81eff426c46414eb3c4a4b4eb155252/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:16.117471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:16.135651 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d585d8-2d13-46b7-a384-47a8a371abbc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:16.191808 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:16.192478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.192784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.193057 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.193778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:16.195369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0829a-10e3-44b2-81c1-82dcde5ec4dd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.209284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1343/2703] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:16.210551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:16.221367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb14a-8536-475d-b137-82f6bcb56b5c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:16.225992 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:16.226924 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.227211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.227496 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] PATH_INFO: `/v3/projects/71ff134442e5414fa957b0fe4156a714/users/b81eff426c46414eb3c4a4b4eb155252/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.229476 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ff134442e5414fa957b0fe4156a714, user_id=b81eff426c46414eb3c4a4b4eb155252, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:16.232134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.242666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1361/2704] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:16 2022] PUT /identity/v3/projects/71ff134442e5414fa957b0fe4156a714/users/b81eff426c46414eb3c4a4b4eb155252/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:16.253511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.253662 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.253949 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.281248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] MFA Rules not processed for user `b81eff426c46414eb3c4a4b4eb155252`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:16.282545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:16.330306 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:16.352751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1344/2705] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:16.363729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:16.365589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:16.424704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa436372-2649-4b0d-8097-caacf5101f0b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:16.428365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:16.429024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:16.429312 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:16.429595 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:16.436414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:16.440566 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:16.442829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0624c58-b5d9-4f2e-a43f-b935aaac77d5 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:16.453572 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1362/2706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:16.978480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:17.040880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549df9-8c95-46e3-8733-14d54ec9acfa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:17.045322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:17.046212 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:17.046495 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:17.046770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] PATH_INFO: `/v3/users/4c7486aa937f4418bc080e4f4a4dacb2` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:17.047944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7486aa937f4418bc080e4f4a4dacb2)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:17.049963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:17.093423 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7486aa937f4418bc080e4f4a4dacb2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.100255 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7486aa937f4418bc080e4f4a4dacb2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.100859 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7486aa937f4418bc080e4f4a4dacb2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.108349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7486aa937f4418bc080e4f4a4dacb2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.120190 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7486aa937f4418bc080e4f4a4dacb2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.126419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1345/2707] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:16 2022] DELETE /identity/v3/users/4c7486aa937f4418bc080e4f4a4dacb2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:17.130601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:17.130972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:17.131313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:17.150034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:17.151333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:17.210013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1363/2708] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:17.220275 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:17.221536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:17.284704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521d0c-e11b-49fe-a942-95a9aa96fdc1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:17.288400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:17.289051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:17.289336 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:17.289612 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:17.299210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:17.300634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:17.310567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1346/2709] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:17.577958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:17.579649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:17.597204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51fd5f-d96e-473a-9434-a8cd50ef25e5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:17.602005 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:17.603437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:17.603729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:17.604010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] PATH_INFO: `/v3/projects/e4b2b77121e24c2f846c053be97217bb` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:17.605208 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b2b77121e24c2f846c053be97217bb)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:17.609270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:17.664395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b2b77121e24c2f846c053be97217bb', 'request_id': 'req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.674756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b2b77121e24c2f846c053be97217bb', 'request_id': 'req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.681783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b2b77121e24c2f846c053be97217bb', 'request_id': 'req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.693659 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] The token cache is being invalidate because project e4b2b77121e24c2f846c053be97217bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:17.694054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.694787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.697571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1364/2710] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:17 2022] DELETE /identity/v3/projects/e4b2b77121e24c2f846c053be97217bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:17.701721 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:17.715523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006a354-4cab-4688-9424-987e2d3420d9 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:17.720796 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:17.777418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:17.778327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:17.778609 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:17.778882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] PATH_INFO: `/v3/users/b81eff426c46414eb3c4a4b4eb155252` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:17.780062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81eff426c46414eb3c4a4b4eb155252)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:17.781980 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:17.832851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81eff426c46414eb3c4a4b4eb155252'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.840508 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81eff426c46414eb3c4a4b4eb155252'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.841078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81eff426c46414eb3c4a4b4eb155252'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.848689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81eff426c46414eb3c4a4b4eb155252'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.860547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-14517d07-83f3-49a7-bc85-8a23f19410bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81eff426c46414eb3c4a4b4eb155252'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:17.866557 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1347/2711] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:17 2022] DELETE /identity/v3/users/b81eff426c46414eb3c4a4b4eb155252 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:18.160960 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.162696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:18.177892 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd620cf-f331-4820-bcd6-7a9ba697b8ff admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.235651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.236523 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.236828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.237105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] PATH_INFO: `/v3/projects/71ff134442e5414fa957b0fe4156a714` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.238350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ff134442e5414fa957b0fe4156a714)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.240228 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.261610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:18.287722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ff134442e5414fa957b0fe4156a714', 'request_id': 'req-b39afcbb-2cde-4684-8910-6719a4ce015f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:18.298705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ff134442e5414fa957b0fe4156a714', 'request_id': 'req-b39afcbb-2cde-4684-8910-6719a4ce015f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:18.305300 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ff134442e5414fa957b0fe4156a714', 'request_id': 'req-b39afcbb-2cde-4684-8910-6719a4ce015f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:18.317115 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] The token cache is being invalidate because project 71ff134442e5414fa957b0fe4156a714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:18.317607 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:18.318319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b39afcbb-2cde-4684-8910-6719a4ce015f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:18.319880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1365/2712] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:18 2022] DELETE /identity/v3/projects/71ff134442e5414fa957b0fe4156a714 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:18.325963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.326817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.327099 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.345982 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:18.347232 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:18.406929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1348/2713] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:18.414679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.414979 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.415780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.434447 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:18.435665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:18.444027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1366/2714] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:18.448294 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.457936 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a1f5a-e553-473e-8aa8-010af07cf966 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.462444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.463091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.463395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.463663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.464437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:18.464770 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.466392 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.477470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1349/2715] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:18.482079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.491220 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91ec3a-716a-42c7-bd47-a1270cbd30d6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.496405 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.497047 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.497327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.497602 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.498427 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.500306 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.525553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1367/2716] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:18 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:18.529505 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.539381 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e32e96-ded9-4885-8152-80afd408b68d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.550978 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:18.597646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.598348 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.598641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.598919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.599754 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.601857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.622655 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1350/2717] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:18 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:18.626750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.637899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fa37-779d-4820-9eee-8404e9bfc48f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.642814 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.643497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.643776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.644051 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.644826 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.646461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.657968 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1368/2718] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:18.661967 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.672635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34e68e-feaa-4f03-993c-76512cfaa140 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.677966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.678666 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.678960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.679238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.679971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.681567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e15b8-bd2a-4078-884f-7ae3939c6c74 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.691848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1351/2719] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:18.696107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.706090 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2904-3483-4655-9844-2aff77247961 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.710647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.711569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.711852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.712652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] PATH_INFO: `/v3/projects/fc8883e5f8184c648a0a5973d12a8e74/users/4477cd194e8645ddbfa06e5f1aae7605/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.727087 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8883e5f8184c648a0a5973d12a8e74, user_id=4477cd194e8645ddbfa06e5f1aae7605, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.730379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.742780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1369/2720] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:18 2022] PUT /identity/v3/projects/fc8883e5f8184c648a0a5973d12a8e74/users/4477cd194e8645ddbfa06e5f1aae7605/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:18.753943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111a67-3668-4e85-a690-b96cf88199db None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.754273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111a67-3668-4e85-a690-b96cf88199db None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.754553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111a67-3668-4e85-a690-b96cf88199db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.780755 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-95111a67-3668-4e85-a690-b96cf88199db None None] MFA Rules not processed for user `4477cd194e8645ddbfa06e5f1aae7605`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:18.781955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-95111a67-3668-4e85-a690-b96cf88199db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:18.842723 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1352/2721] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:18.854229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:18.855865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:18.911378 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31985d14-b6cd-483a-8332-46fd4cd14e04 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:18.914897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:18.915530 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:18.915813 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:18.916088 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:18.924142 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:18.925565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:18.934099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1370/2722] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:20.294387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31606-6646-44d1-8eb7-77d3ee9e110c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:20.294893 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31606-6646-44d1-8eb7-77d3ee9e110c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:20.295006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31606-6646-44d1-8eb7-77d3ee9e110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:20.312189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1bb31606-6646-44d1-8eb7-77d3ee9e110c None None] MFA Rules not processed for user `4477cd194e8645ddbfa06e5f1aae7605`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:20.313402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1bb31606-6646-44d1-8eb7-77d3ee9e110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:20.320166 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1353/2723] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:28.757952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:28.759509 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:28.826539 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:28.845071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c56fb-44c9-4900-867c-fc651e6c7f99 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:28.849769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:28.850784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:28.851072 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:28.851347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] PATH_INFO: `/v3/users/92b905a8fcd748a79f03214ee57f7364` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:28.852541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b905a8fcd748a79f03214ee57f7364)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:28.854985 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:28.906926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b905a8fcd748a79f03214ee57f7364'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:28.914556 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b905a8fcd748a79f03214ee57f7364'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:28.915212 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b905a8fcd748a79f03214ee57f7364'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:28.922977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b905a8fcd748a79f03214ee57f7364'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:28.943258 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b905a8fcd748a79f03214ee57f7364'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:28.949209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1371/2724] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:28 2022] DELETE /identity/v3/users/92b905a8fcd748a79f03214ee57f7364 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:28.953606 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:28.954086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:28.954227 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:28.971894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:28.973258 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:29.035409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1354/2725] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:29.045399 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:29.046829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:29.105315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9b78-377c-48fc-8304-4c3ac46d6e60 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:29.109036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:29.109693 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:29.109973 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:29.110311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:29.124913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:29.126537 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:29.136678 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1372/2726] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:29.419659 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:29.421528 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:29.441369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a35ef7-fee5-43ea-b454-9c176c3420af None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:29.446454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:29.448139 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:29.448531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:29.448952 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] PATH_INFO: `/v3/projects/7b27ce25b87c4de5bebb2617192c183b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:29.450568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b27ce25b87c4de5bebb2617192c183b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:29.452913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:29.466832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:29.501136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b27ce25b87c4de5bebb2617192c183b', 'request_id': 'req-a06c38dc-0421-4fa1-89c9-acb0c3764eae'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.508445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b27ce25b87c4de5bebb2617192c183b', 'request_id': 'req-a06c38dc-0421-4fa1-89c9-acb0c3764eae'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.515096 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b27ce25b87c4de5bebb2617192c183b', 'request_id': 'req-a06c38dc-0421-4fa1-89c9-acb0c3764eae'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.526961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] The token cache is being invalidate because project 7b27ce25b87c4de5bebb2617192c183b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:29.527385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.528134 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.529704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1355/2727] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:29 2022] DELETE /identity/v3/projects/7b27ce25b87c4de5bebb2617192c183b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:29.533654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:29.543432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d321c3-1565-412c-ae15-67af115490c0 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:29.600451 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:29.601328 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:29.601663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:29.601883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] PATH_INFO: `/v3/users/69a9acc29f3940a8b2b097d156fda56a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:29.603093 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a9acc29f3940a8b2b097d156fda56a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:29.605004 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:29.615687 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:29.655267 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a9acc29f3940a8b2b097d156fda56a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.663885 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a9acc29f3940a8b2b097d156fda56a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.664849 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a9acc29f3940a8b2b097d156fda56a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.672109 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a9acc29f3940a8b2b097d156fda56a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.684045 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-63fa7732-3622-43b2-bf95-53ead3744e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a9acc29f3940a8b2b097d156fda56a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:29.690493 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1373/2728] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:29 2022] DELETE /identity/v3/users/69a9acc29f3940a8b2b097d156fda56a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:29.967691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:29.969214 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:29.982401 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c38dc-0421-4fa1-89c9-acb0c3764eae admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.055153 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.057070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.057070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.057426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] PATH_INFO: `/v3/projects/f712fe9fee634010af5c9fd24b6cff3c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.058461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f712fe9fee634010af5c9fd24b6cff3c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.060370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.068901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc193-3573-43f4-ab3d-0e1f02c831b5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.069432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc193-3573-43f4-ab3d-0e1f02c831b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.069532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc193-3573-43f4-ab3d-0e1f02c831b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.089313 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ba6fc193-3573-43f4-ab3d-0e1f02c831b5 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:30.090571 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ba6fc193-3573-43f4-ab3d-0e1f02c831b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.133608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f712fe9fee634010af5c9fd24b6cff3c', 'request_id': 'req-610dbf7f-4b08-4b59-b606-65fafbf5b834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:30.143716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f712fe9fee634010af5c9fd24b6cff3c', 'request_id': 'req-610dbf7f-4b08-4b59-b606-65fafbf5b834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:30.150101 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f712fe9fee634010af5c9fd24b6cff3c', 'request_id': 'req-610dbf7f-4b08-4b59-b606-65fafbf5b834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:30.159580 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1374/2729] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:30.163208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] The token cache is being invalidate because project f712fe9fee634010af5c9fd24b6cff3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:30.163504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:30.164148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:30.169733 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1356/2730] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:29 2022] DELETE /identity/v3/projects/f712fe9fee634010af5c9fd24b6cff3c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:30.171528 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49504dc-0ddc-43e8-8bc9-c41bb5631964 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.171901 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49504dc-0ddc-43e8-8bc9-c41bb5631964 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.172249 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49504dc-0ddc-43e8-8bc9-c41bb5631964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.194521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b49504dc-0ddc-43e8-8bc9-c41bb5631964 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:30.195833 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b49504dc-0ddc-43e8-8bc9-c41bb5631964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.212256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.213676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.249174 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:30.258006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1375/2731] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:30.266334 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.266635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.266918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.284956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:30.286226 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.288757 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbf7f-4b08-4b59-b606-65fafbf5b834 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.294661 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.294871 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1376/2732] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:30.295313 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.295598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.295944 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.297741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.299061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.308798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304c64e-fa48-4805-9cec-db96ed80e31f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.314397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.315058 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.315343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.315622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.316350 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:30.316660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.318271 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.330817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1377/2733] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:06:30.334836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.344276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77716840-da2d-4313-9ed0-8cbcb7f543cd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.348953 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.349583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.349870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.350282 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.350915 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.352942 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.363876 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:30.365894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.367684 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.377437 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1357/2734] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:30.385770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1378/2735] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:30.386914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.398090 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7d41-b519-4325-b808-11848d6b2e5f service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.470256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.471130 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.471416 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.471731 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.472466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.474568 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.501914 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1358/2736] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:30.506679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.520836 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a436-8088-4e92-af68-bb8e1ca5adcd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.526860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.527538 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.527825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.528134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.528905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.531211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.546619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1379/2737] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:30.550626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.564784 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05f2c9-d17a-4d09-adad-798ed76cce65 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.570640 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.571323 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.571608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.572492 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.573240 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.574897 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ba3fa-ab46-4328-bb20-37d3df8c3d7e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.586456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1359/2738] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:30.590921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.602074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437271-5392-4ad2-a0eb-997a9d3f4e23 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.606817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.607709 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.608144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.608430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] PATH_INFO: `/v3/projects/34b79b38cf084143a9603c977fe0cb1d/users/217451b96e494dd4bc1625c229d6ac54/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.626990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b79b38cf084143a9603c977fe0cb1d, user_id=217451b96e494dd4bc1625c229d6ac54, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.631053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.651335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1380/2739] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:30 2022] PUT /identity/v3/projects/34b79b38cf084143a9603c977fe0cb1d/users/217451b96e494dd4bc1625c229d6ac54/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:30.664353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.664854 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.664966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.712257 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] MFA Rules not processed for user `217451b96e494dd4bc1625c229d6ac54`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:30.714362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:30.764526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:30.796071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1360/2740] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:30.800686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.871134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74ccd-fc53-43a0-b234-ec57b18c6f02 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.876998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.878460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:30.878460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:30.878460 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:30.879341 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:30.881392 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:30.909753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1381/2741] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:30.913955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:30.928874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a3019-b7f6-4f22-a370-88359d5fc9f3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:30.999462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:30.999462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.000226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.000226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.001044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.003894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.034445 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1361/2742] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:30 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:31.038662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:31.050799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159706c5-ecd7-4cc3-adfa-7dad4460199e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:31.058925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:31.059818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.060275 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.060719 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.061787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.064649 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.078991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1382/2743] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:31.083521 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:31.095072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb82b5-0678-489d-8299-dbd26d99e2ab admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:31.101458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:31.102537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.102872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.103658 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] PATH_INFO: `/v3/projects/033efde7f8874d3cbb1846cc2775bbf5/users/ff459895cac54d09abd60851b1711148/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.131884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033efde7f8874d3cbb1846cc2775bbf5, user_id=ff459895cac54d09abd60851b1711148, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.135187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.152307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1362/2744] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:31 2022] PUT /identity/v3/projects/033efde7f8874d3cbb1846cc2775bbf5/users/ff459895cac54d09abd60851b1711148/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:31.156933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:31.168697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed02e8-9865-4f5e-b22f-3349c03e2350 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:31.248619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:31.249756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.250319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.250673 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.251852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.254325 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011d587-6e3d-46bb-b3a6-5d4f913f7a48 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.267582 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1383/2745] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:31.272121 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:31.284804 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238637-ef04-46b3-82df-e050bc6aba86 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:31.291966 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:31.292992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.293283 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.293567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] PATH_INFO: `/v3/projects/033efde7f8874d3cbb1846cc2775bbf5/users/ff459895cac54d09abd60851b1711148/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.295620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033efde7f8874d3cbb1846cc2775bbf5, user_id=ff459895cac54d09abd60851b1711148, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.298297 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.310456 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1363/2746] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:31 2022] PUT /identity/v3/projects/033efde7f8874d3cbb1846cc2775bbf5/users/ff459895cac54d09abd60851b1711148/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:31.320397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.320795 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.321113 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.357096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] MFA Rules not processed for user `ff459895cac54d09abd60851b1711148`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:31.358364 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:31.372186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:31.437512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1384/2747] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:31.448385 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:31.450349 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:31.520489 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4229-9cfa-4af9-9202-23f102743551 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:31.524322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:31.525024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:31.525311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:31.525592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:31.579050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:31.596507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:31.598205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6be27-46d8-4445-bce8-a89774437499 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:31.608672 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1364/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:34.486315 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:34.487758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:34.508634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ee2ea-9da1-4444-9bee-fb48c5c5926c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:34.525211 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:34.526983 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:34.527370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:34.527777 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:34.542284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:34.544080 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:34.557818 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1385/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:38.531318 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f357-6f05-4482-b725-13577a3c8c2c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:38.532457 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f357-6f05-4482-b725-13577a3c8c2c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:38.532965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f357-6f05-4482-b725-13577a3c8c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:38.554093 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a544f357-6f05-4482-b725-13577a3c8c2c None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:38.556045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a544f357-6f05-4482-b725-13577a3c8c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:38.619439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1365/2750] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:38.640291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:38.784439 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a09a5-308b-4931-bf2f-8b130f0e98b5 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:38.799562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:38.803331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:38.803647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:38.803932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:38.836843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:38.844437 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:38.874617 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1386/2751] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:06:39.697218 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207c00-4f51-4fa2-a888-1ed873ffa5e9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:39.697704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207c00-4f51-4fa2-a888-1ed873ffa5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:39.698077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207c00-4f51-4fa2-a888-1ed873ffa5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:39.725154 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cb207c00-4f51-4fa2-a888-1ed873ffa5e9 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:39.726458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cb207c00-4f51-4fa2-a888-1ed873ffa5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:39.741626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1366/2752] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:39.759323 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:39.770891 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57584-6c22-441b-af74-527485cf7a4a service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:39.778912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:39.779800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:39.780083 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:39.780362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:39.792999 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:39.794935 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:39.804670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1387/2753] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:06:40.028230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387d97-109b-4f63-8eef-18a58ae94335 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:40.028645 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387d97-109b-4f63-8eef-18a58ae94335 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:40.029026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12387d97-109b-4f63-8eef-18a58ae94335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:40.050418 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-12387d97-109b-4f63-8eef-18a58ae94335 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:40.052692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12387d97-109b-4f63-8eef-18a58ae94335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:40.064360 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1367/2754] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Jul 13 09:06:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:40.078469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:40.091926 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e33f-2132-4abc-b9ca-fc20d2b580c7 service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:40.098024 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:40.099286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:40.099895 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:40.100240 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:40.128040 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:40.130048 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:40.140741 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1388/2755] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:06:40.574194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:40.574644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:40.575118 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:40.593545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:40.595181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:40.602278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1368/2756] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:06:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:40.617367 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:40.628358 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48937b4-c2e1-481c-960f-01b464e694bf service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:40.636239 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:40.636893 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:40.637383 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:40.637854 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:40.647319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:40.649138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22711c-184c-47e7-bd16-bdfd997d167e service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:40.660234 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1389/2757] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:43.172249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:43.174013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:43.259596 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb4037-2828-4d0c-a5e7-a8ce34de129f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:43.265062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:43.266031 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:43.266477 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:43.266756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] PATH_INFO: `/v3/users/4477cd194e8645ddbfa06e5f1aae7605` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:43.268106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4477cd194e8645ddbfa06e5f1aae7605)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:43.270351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:43.332468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4477cd194e8645ddbfa06e5f1aae7605'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:43.343626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4477cd194e8645ddbfa06e5f1aae7605'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:43.344766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4477cd194e8645ddbfa06e5f1aae7605'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:43.353617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4477cd194e8645ddbfa06e5f1aae7605'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:43.363016 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:43.368530 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4477cd194e8645ddbfa06e5f1aae7605'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:43.378455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1369/2758] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:43 2022] DELETE /identity/v3/users/4477cd194e8645ddbfa06e5f1aae7605 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:43.382903 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:43.383850 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:43.384311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:43.408913 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:43.409277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:43.461872 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:43.483232 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1390/2759] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:43.492837 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:43.494549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:43.560652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:43.562327 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:43.581133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210071b-720e-41f8-98a7-25b18f4bc534 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:43.587806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:43.589376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:43.589766 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:43.590678 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:43.604906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:43.607021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:43.631888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1370/2760] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:43.662877 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827118a-6198-487f-af30-a7721a4a4de2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:43.669257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:43.672858 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:43.673246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:43.673605 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:43.679688 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:43.698086 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:43.700540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:43.719746 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1391/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:06:43.804389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:43.821077 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0b310-bb28-4ddf-b239-7f26409edcfe service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:43.832461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:43.833307 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:43.833660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:43.834007 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:43.837797 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:44.019833 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.026878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b9b04-59c7-4a2e-a934-fd31db864470 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.036394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.038302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:44.049862 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1371/2762] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:44.083161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616f71e-bfc9-47a4-9b28-fbb06763a3a8 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.091246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.092938 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.093291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.093666 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] PATH_INFO: `/v3/projects/fc8883e5f8184c648a0a5973d12a8e74` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.095054 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8883e5f8184c648a0a5973d12a8e74)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.097074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.192691 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8883e5f8184c648a0a5973d12a8e74', 'request_id': 'req-6507d972-ecaa-495f-af6a-3a929565befb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:44.203521 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8883e5f8184c648a0a5973d12a8e74', 'request_id': 'req-6507d972-ecaa-495f-af6a-3a929565befb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:44.213310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8883e5f8184c648a0a5973d12a8e74', 'request_id': 'req-6507d972-ecaa-495f-af6a-3a929565befb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:44.232263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] The token cache is being invalidate because project fc8883e5f8184c648a0a5973d12a8e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:44.232654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:44.233456 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6507d972-ecaa-495f-af6a-3a929565befb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:44.235498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1392/2763] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:44 2022] DELETE /identity/v3/projects/fc8883e5f8184c648a0a5973d12a8e74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:44.240414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.240908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.241006 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.263883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:44.265310 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:44.336803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1372/2764] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:44.404847 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.405642 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.406092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.458783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:44.460276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:44.473656 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1393/2765] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:44.474930 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.489080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ca3a-2a24-4a31-a5a7-37bd3b5c416c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.494884 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.496080 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.496549 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.497060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.498071 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:44.498462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.500198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.541317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1373/2766] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:44.545672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.569184 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b114a-f14f-4e2c-bce9-1334e4350507 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.580848 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.581722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.582654 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.583098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.585002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.589195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.651330 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1394/2767] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:44 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:44.656045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.668649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbe227-929e-4daa-b433-2a7a6a0cbd77 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.674242 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:44.754743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.756768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.756768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.756768 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.757644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.760202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.794710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1374/2768] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:44 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:44.796318 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.809647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696310fb-3c7b-44d1-b8f3-b10bf61c4956 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.815542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.816356 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.816723 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.816998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.817883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.820144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.834217 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1395/2769] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:44.838043 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.850029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282417-50b5-406e-b540-42396b56d727 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.856540 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.857225 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.857608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.858013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.858791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.860425 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cfc6e-4a5f-419d-9495-b8550a051ac0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.874181 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1375/2770] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:44.877177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:44.890633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67d48-4e47-4f56-b4c6-4e388ed7012d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:44.896859 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:44.897997 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.898308 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.898583 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] PATH_INFO: `/v3/projects/a27d6b6f895b4057bd91ef67a0a3da1c/users/2d2f11da308242e99dc0d79be013e15b/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:44.945865 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27d6b6f895b4057bd91ef67a0a3da1c, user_id=2d2f11da308242e99dc0d79be013e15b, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:44.955398 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:44.984414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1396/2771] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:44 2022] PUT /identity/v3/projects/a27d6b6f895b4057bd91ef67a0a3da1c/users/2d2f11da308242e99dc0d79be013e15b/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:44.996377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753af3e-645a-49c3-a90c-d9f6d0ae013d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:44.996676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753af3e-645a-49c3-a90c-d9f6d0ae013d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:44.997029 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753af3e-645a-49c3-a90c-d9f6d0ae013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:45.038499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c753af3e-645a-49c3-a90c-d9f6d0ae013d None None] MFA Rules not processed for user `2d2f11da308242e99dc0d79be013e15b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:45.039751 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c753af3e-645a-49c3-a90c-d9f6d0ae013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:45.155273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1376/2772] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:45.170222 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:45.172085 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:45.178727 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:45.253549 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc25f9-f4b1-4096-a59a-dbb5f2e9aaef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:45.260939 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:45.266265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:45.266730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:45.267177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:45.278188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:45.279844 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:45.291888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1397/2773] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:06:47.632943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643837-a476-410e-b516-cbe818601e05 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:47.633402 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643837-a476-410e-b516-cbe818601e05 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:47.633531 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643837-a476-410e-b516-cbe818601e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:47.651943 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7f643837-a476-410e-b516-cbe818601e05 None None] MFA Rules not processed for user `123e880f189146e4bae93a06a981fbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:47.653133 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f643837-a476-410e-b516-cbe818601e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:47.705951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1377/2774] 10.222.0.49 () {58 vars in 967 bytes} [Wed Jul 13 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:47.718298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:47.719670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:47.788305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea927b1-c7c0-46c3-9dc1-94f14349142a service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:47.793867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e317b8e3c61b456281c6f99da6c7a77b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:47.794542 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:47.794830 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:47.795111 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:47.805704 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:47.807319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481ff5f-065c-4072-908f-399a075dec6a service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:47.815917 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1398/2775] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Jul 13 09:06:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:06:48.061246 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643837-a476-410e-b516-cbe818601e05 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:48.062935 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f643837-a476-410e-b516-cbe818601e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:48.087657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:48.140237 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f643837-a476-410e-b516-cbe818601e05 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:48.145062 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:48.145933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:48.146322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:48.146534 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] PATH_INFO: `/v3/users/217451b96e494dd4bc1625c229d6ac54` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:48.148088 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217451b96e494dd4bc1625c229d6ac54)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:48.151186 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:48.202065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217451b96e494dd4bc1625c229d6ac54'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.208878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217451b96e494dd4bc1625c229d6ac54'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.209532 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217451b96e494dd4bc1625c229d6ac54'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.217464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217451b96e494dd4bc1625c229d6ac54'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.229344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217451b96e494dd4bc1625c229d6ac54'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.236795 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1378/2776] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:48 2022] DELETE /identity/v3/users/217451b96e494dd4bc1625c229d6ac54 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:48.241466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:48.241783 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:48.242039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:48.260760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:48.262044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:48.328340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1399/2777] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:48.338860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:48.340287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:48.407361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694bcc-88bd-4475-8759-16770c04ef44 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:48.411740 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:48.412449 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:48.412716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:48.413013 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:48.422961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:48.424441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:48.439021 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1379/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:48.838753 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:48.840532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:48.862227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599c83-6cab-4e5d-a1c5-ea7fb5badfdc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:48.871861 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:48.872784 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:48.873071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:48.873344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] PATH_INFO: `/v3/projects/34b79b38cf084143a9603c977fe0cb1d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:48.874710 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b79b38cf084143a9603c977fe0cb1d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:48.876781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:48.911096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:48.926055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b79b38cf084143a9603c977fe0cb1d', 'request_id': 'req-096fcf97-33b2-434e-aa54-d3274f6d46d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.934914 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b79b38cf084143a9603c977fe0cb1d', 'request_id': 'req-096fcf97-33b2-434e-aa54-d3274f6d46d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.941344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b79b38cf084143a9603c977fe0cb1d', 'request_id': 'req-096fcf97-33b2-434e-aa54-d3274f6d46d9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.951721 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] The token cache is being invalidate because project 34b79b38cf084143a9603c977fe0cb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:48.952010 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.952680 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:48.954248 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1400/2779] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:48 2022] DELETE /identity/v3/projects/34b79b38cf084143a9603c977fe0cb1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:48.958339 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:48.968143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851d353-cff0-495b-a18a-2c294ac54767 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:49.008947 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:49.030369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:49.031278 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.031559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.031835 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] PATH_INFO: `/v3/users/ff459895cac54d09abd60851b1711148` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.033042 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff459895cac54d09abd60851b1711148)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:49.035020 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:49.084476 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff459895cac54d09abd60851b1711148'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.091714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff459895cac54d09abd60851b1711148'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.092324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff459895cac54d09abd60851b1711148'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.099204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff459895cac54d09abd60851b1711148'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.111969 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-06bdcdd7-1316-4b17-91ca-5033ab6bc752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff459895cac54d09abd60851b1711148'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.118155 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1380/2780] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:48 2022] DELETE /identity/v3/users/ff459895cac54d09abd60851b1711148 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:49.414317 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:49.416519 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:49.434743 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcf97-33b2-434e-aa54-d3274f6d46d9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:49.510831 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:49.512610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.512610 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.512905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] PATH_INFO: `/v3/projects/033efde7f8874d3cbb1846cc2775bbf5` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.519662 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033efde7f8874d3cbb1846cc2775bbf5)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:49.523094 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:49.592781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033efde7f8874d3cbb1846cc2775bbf5', 'request_id': 'req-8b94b32a-c309-4f62-b8b4-6732d11d1c72'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.601897 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033efde7f8874d3cbb1846cc2775bbf5', 'request_id': 'req-8b94b32a-c309-4f62-b8b4-6732d11d1c72'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.609105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033efde7f8874d3cbb1846cc2775bbf5', 'request_id': 'req-8b94b32a-c309-4f62-b8b4-6732d11d1c72'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.621928 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] The token cache is being invalidate because project 033efde7f8874d3cbb1846cc2775bbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:49.622255 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.622933 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b94b32a-c309-4f62-b8b4-6732d11d1c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.624730 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1401/2781] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:49 2022] DELETE /identity/v3/projects/033efde7f8874d3cbb1846cc2775bbf5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:49.630616 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.630919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.631207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.666292 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:49.667639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:49.787324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1381/2782] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:49.795995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.796284 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.796562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.806654 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:49.816801 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:49.833564 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:49.839188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:49.840987 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff613f5-c270-4820-aa3c-a2bf8e0ed0d6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:49.846747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:49.847639 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.847922 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.848231 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] PATH_INFO: `/v3/users/0b661af512234879bf4c056e92832dcd` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.849603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b661af512234879bf4c056e92832dcd)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:49.852209 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:49.853618 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1402/2783] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:49.857734 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:49.872134 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5bdea-183e-4d84-ab54-23e6390fd663 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:49.877169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:49.877837 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.878141 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.878422 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.879374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:49.879763 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:49.882374 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:49.897227 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1403/2784] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:49.902925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:49.912024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b661af512234879bf4c056e92832dcd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.913104 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4776-f8d4-47e0-87f3-55d42cf9e844 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:49.918461 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:49.919127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:49.919404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:49.919679 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:49.920366 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:49.921452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b661af512234879bf4c056e92832dcd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.922274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:49.922419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b661af512234879bf4c056e92832dcd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.924747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:49.931687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b661af512234879bf4c056e92832dcd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.950359 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b661af512234879bf4c056e92832dcd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:49.953018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1404/2785] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:49 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:49.957008 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:49.958647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:49.962940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1382/2786] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:49 2022] DELETE /identity/v3/users/0b661af512234879bf4c056e92832dcd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:49.973634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.040852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b8b5-922b-4d56-88be-2b302ab0fe6f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.096056 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.096733 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.097022 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.097302 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.097989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.099962 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.131078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1405/2787] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:49 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:50.135959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.144041 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.145978 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.147026 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cee3-4c69-4e5d-bdd1-c33e7ebd7742 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.152363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.153038 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.153319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.153629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.154377 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.156051 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.159331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc64b1-879a-43f4-9442-61ab784425e8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.167650 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.168320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1383/2788] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:50.170390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.170694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.171068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] PATH_INFO: `/v3/projects/23ff658fa875427286bbe89ed32dae4b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.172148 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.172376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff658fa875427286bbe89ed32dae4b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.174339 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.183660 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ed9-cab7-48ee-a500-517546c4224d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.189490 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.190180 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.190469 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.190747 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.191470 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.193060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.203471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1384/2789] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:50.207473 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.218643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56f44-0c2e-4066-8356-61df3ef1f796 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.224731 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff658fa875427286bbe89ed32dae4b', 'request_id': 'req-036abcd7-9804-4531-b8b5-72efd17a4e8c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.234431 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff658fa875427286bbe89ed32dae4b', 'request_id': 'req-036abcd7-9804-4531-b8b5-72efd17a4e8c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.245213 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff658fa875427286bbe89ed32dae4b', 'request_id': 'req-036abcd7-9804-4531-b8b5-72efd17a4e8c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.257472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] The token cache is being invalidate because project 23ff658fa875427286bbe89ed32dae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:50.257771 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.258541 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-036abcd7-9804-4531-b8b5-72efd17a4e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.263342 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1406/2790] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:50 2022] DELETE /identity/v3/projects/23ff658fa875427286bbe89ed32dae4b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:50.265609 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d226-010e-4589-adc9-47c4f5628670 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.265839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d226-010e-4589-adc9-47c4f5628670 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.266165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d226-010e-4589-adc9-47c4f5628670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.285694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-91a9d226-010e-4589-adc9-47c4f5628670 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:50.287026 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-91a9d226-010e-4589-adc9-47c4f5628670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.288848 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.289846 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.290809 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.291091 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] PATH_INFO: `/v3/projects/df74932c9d984dbd8d3f1bbcd9d75974/users/6329cf616b5a46da990c88fdb7d10ce8/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.296182 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1407/2791] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:50.303452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.303747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.304030 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.309790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df74932c9d984dbd8d3f1bbcd9d75974, user_id=6329cf616b5a46da990c88fdb7d10ce8, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.312680 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26becd6-d9c9-496b-abeb-67f81ccfef38 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.328655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:50.329972 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.334204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1385/2792] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:50 2022] PUT /identity/v3/projects/df74932c9d984dbd8d3f1bbcd9d75974/users/6329cf616b5a46da990c88fdb7d10ce8/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:50.339887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.340286 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.340714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.348007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.378962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] MFA Rules not processed for user `6329cf616b5a46da990c88fdb7d10ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:50.380197 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.401193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1408/2793] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:50.405311 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.416028 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ee27-db4f-471f-a9dc-5ebe3a9f5476 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.422291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.423092 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.423379 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.423835 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.424614 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:50.424921 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.426593 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.444310 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1409/2794] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:06:50.445289 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.455762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b928c-2e7d-416e-bbbe-f3e8a9d977b2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.460635 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.461286 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.461567 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.461906 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.462799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1386/2795] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:50.462920 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.464576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.467140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.468541 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.484248 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848f6c-e118-4589-986e-2c2d05c6a3a0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.489056 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.489713 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.489993 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.490299 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.490979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.492885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.495091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1410/2796] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:50.499195 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.519775 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1387/2797] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:50.523595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.527924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.562624 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793bda-9a39-48cc-8bc2-2a9853884524 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.587567 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946a530-0ada-4342-b342-527c97ac5290 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.592976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.593461 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.593743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.594018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.594730 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.596620 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.619614 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1388/2798] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:50.623107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.623752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.624890 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.625052 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.625343 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.625620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.626338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.628270 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.637391 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60816-b606-46a1-9056-3383df55dc49 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.642939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.643898 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.644187 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.644494 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] PATH_INFO: `/v3/users/2d2f11da308242e99dc0d79be013e15b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.645703 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2f11da308242e99dc0d79be013e15b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.647644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.649023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1411/2799] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:06:50.650448 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.660068 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa22e-520d-4e23-b6b8-e7e57d9dcc29 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.664936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.665589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.665875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.666183 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.666912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.668488 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.678786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1412/2800] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:50.679663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.689676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588133e-db8e-4586-bf5f-b35adbdfe431 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.694348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.694990 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.695277 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.695555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.696781 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.698370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.702948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2f11da308242e99dc0d79be013e15b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.703518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.710280 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1413/2801] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:50.711233 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.714280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2f11da308242e99dc0d79be013e15b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.714981 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2f11da308242e99dc0d79be013e15b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.721979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2f11da308242e99dc0d79be013e15b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.723739 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0b6a-56a5-4421-aa89-025d62bd99ca admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.728531 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.729397 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.729686 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.729964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.730787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.732347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425f9a8-5fce-4303-b808-5596e2e2e528 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.734279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2f11da308242e99dc0d79be013e15b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:50.740347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1389/2802] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:50 2022] DELETE /identity/v3/users/2d2f11da308242e99dc0d79be013e15b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:50.741119 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.742499 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.742799 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1414/2803] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:50.747440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.747728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.748002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.766138 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:50.767357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.807389 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3922a-f1ff-4167-b151-993ead515a54 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.812251 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.812917 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.813196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.813474 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.814221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.815806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.821881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:50.825812 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1415/2804] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:50.826716 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.827452 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1390/2805] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:50.831111 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.831260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.843246 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd346c-24a1-48a6-82fd-b8dcb439ece9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.844390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f986da-3472-45ed-bc88-4cbbead021c0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:50.850061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.851108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:50.851260 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.851419 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.851699 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] PATH_INFO: `/v3/projects/f83468bf5687430fa3b46a110324ddab/users/ec1a7a3b56e947aca4c47dc5a78697e3/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.853140 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.853522 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.853908 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] PATH_INFO: `/v3/projects/574bbaa312e04bb0824f79e5ac6534fe/users/82ac8161edf248bf8d2117de888b2105/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.867621 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83468bf5687430fa3b46a110324ddab, user_id=ec1a7a3b56e947aca4c47dc5a78697e3, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.870900 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.872370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=574bbaa312e04bb0824f79e5ac6534fe, user_id=82ac8161edf248bf8d2117de888b2105, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:50.875172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd32a-fd50-4670-8d45-a4a8a171f0cb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:50.895035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1416/2806] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:50 2022] PUT /identity/v3/projects/f83468bf5687430fa3b46a110324ddab/users/ec1a7a3b56e947aca4c47dc5a78697e3/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:50.895035 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:50.896880 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.904900 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1391/2807] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:50 2022] PUT /identity/v3/projects/574bbaa312e04bb0824f79e5ac6534fe/users/82ac8161edf248bf8d2117de888b2105/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:50.906518 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53cce-a9db-4f33-8118-3a63c504b621 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:50.906708 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53cce-a9db-4f33-8118-3a63c504b621 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:50.906915 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53cce-a9db-4f33-8118-3a63c504b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:50.937172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1ea53cce-a9db-4f33-8118-3a63c504b621 None None] MFA Rules not processed for user `ec1a7a3b56e947aca4c47dc5a78697e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:50.938904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1ea53cce-a9db-4f33-8118-3a63c504b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:50.979588 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e5e-988b-430e-bf8a-2efbc1a51142 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.015107 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1392/2808] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:51.016414 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.016826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.016951 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.033520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.034210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.034498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.034774 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.043853 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] MFA Rules not processed for user `82ac8161edf248bf8d2117de888b2105`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:51.045061 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.070076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:51.099362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.100779 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.109413 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1393/2809] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:51.110982 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1417/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:51.111435 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.123344 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.123587 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62fbf8-0294-4cb6-b7a3-c1e6c6d2c282 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.125508 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.128717 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.129504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.129793 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.130094 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.131039 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.133527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.169613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1394/2811] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:51 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:51.174327 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.193065 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43513df-e260-4e23-a769-72ca74e530c2 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.216220 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:51.248155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.248936 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.249219 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.249517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.255128 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524768a-47d6-456f-bbf1-9fe15cda9b87 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.263267 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.264322 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.264633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.264961 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.265909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.268003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.289743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1395/2812] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:51 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:51.293552 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.309285 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cae3-0942-47c0-9954-bfead49a625d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.317369 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.318037 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.318352 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.318626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.319351 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.321926 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.326955 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.328976 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.335704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1396/2813] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:51.336553 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.339791 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1418/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:51.347929 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65915517-9a87-4e9b-a809-29a01ccf40f8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.353482 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.354426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.354706 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.354985 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] PATH_INFO: `/v3/projects/77595fec9c1e438198608c3e7881bc99/users/8f15c2804daa4cb5acba637215509b4c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.378298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77595fec9c1e438198608c3e7881bc99, user_id=8f15c2804daa4cb5acba637215509b4c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.381050 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.396705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.398375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.398788 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1397/2815] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:51 2022] PUT /identity/v3/projects/77595fec9c1e438198608c3e7881bc99/users/8f15c2804daa4cb5acba637215509b4c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:51.405270 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.434396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa037-81e0-4513-b3ed-cb134fbfc21c service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.474127 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f1206-6298-4e41-9543-6479c596673e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.478894 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.479562 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.479841 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.480116 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.480857 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.482372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:51.482519 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.492679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1398/2816] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:06:51.497250 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.507123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.508137 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.508555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.509390 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] PATH_INFO: `/v3/projects/a27d6b6f895b4057bd91ef67a0a3da1c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.509524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603622a-d1a9-46e9-89d9-596843716513 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.510674 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27d6b6f895b4057bd91ef67a0a3da1c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.513918 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.514663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.515646 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.516002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.516343 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] PATH_INFO: `/v3/projects/77595fec9c1e438198608c3e7881bc99/users/8f15c2804daa4cb5acba637215509b4c/roles/e3ea2fe66d56423a93654b34570d047c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.518455 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77595fec9c1e438198608c3e7881bc99, user_id=8f15c2804daa4cb5acba637215509b4c, role_id=e3ea2fe66d56423a93654b34570d047c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.521124 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8d8b0-a167-44be-8210-0f8a29c6c64b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.531781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1399/2817] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:51 2022] PUT /identity/v3/projects/77595fec9c1e438198608c3e7881bc99/users/8f15c2804daa4cb5acba637215509b4c/roles/e3ea2fe66d56423a93654b34570d047c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:51.543329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.543624 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.543924 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.573158 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] MFA Rules not processed for user `8f15c2804daa4cb5acba637215509b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:51.574905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.577486 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27d6b6f895b4057bd91ef67a0a3da1c', 'request_id': 'req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:51.588715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27d6b6f895b4057bd91ef67a0a3da1c', 'request_id': 'req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:51.595633 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27d6b6f895b4057bd91ef67a0a3da1c', 'request_id': 'req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:51.609173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] The token cache is being invalidate because project a27d6b6f895b4057bd91ef67a0a3da1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:51.609606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:51.610532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:51.612766 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1419/2818] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:51 2022] DELETE /identity/v3/projects/a27d6b6f895b4057bd91ef67a0a3da1c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:51.649959 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:51.666989 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1400/2819] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:06:51.678725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.683173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.791497 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b57-c8e2-4edf-9cca-efe35610d9c9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.801193 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.802896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.802896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.802896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.823263 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.825752 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.841896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1420/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:51.895806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:51.897408 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.909791 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e787-1d34-44d2-a4ee-173da791da27 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:51.914001 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:51.915419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:51.915762 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:51.916105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:51.918003 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:51.987918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:51.989376 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f1001-b40c-4cfe-96ed-d388d18d0b22 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:51.999410 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1401/2821] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:54.876128 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:54.877512 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:54.942793 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c03863-75c0-451c-9e03-b95e366898a1 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:54.947265 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:54.948123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:54.948406 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:54.948681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] PATH_INFO: `/v3/users/6329cf616b5a46da990c88fdb7d10ce8` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:54.949852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6329cf616b5a46da990c88fdb7d10ce8)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:54.951769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:54.969904 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:54.999012 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6329cf616b5a46da990c88fdb7d10ce8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.005815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6329cf616b5a46da990c88fdb7d10ce8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.006424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6329cf616b5a46da990c88fdb7d10ce8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.013631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6329cf616b5a46da990c88fdb7d10ce8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.025898 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6329cf616b5a46da990c88fdb7d10ce8'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.031769 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1421/2822] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:54 2022] DELETE /identity/v3/users/6329cf616b5a46da990c88fdb7d10ce8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:55.036368 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:55.036912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:55.036912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:55.054459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:55.056234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:55.111671 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1402/2823] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:55.121713 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:55.123230 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:55.178576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22cf22-5a75-4202-a5e8-38e009b27b87 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:55.182804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:55.183445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:55.183722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:55.183996 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:55.192694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:55.194098 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:55.203365 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1422/2824] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:06:55.469287 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:55.470883 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:55.485516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced163-1189-4ebf-88e8-2b086b211cc5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:55.490827 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:55.491802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:55.491975 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:55.492249 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] PATH_INFO: `/v3/projects/df74932c9d984dbd8d3f1bbcd9d75974` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:55.493436 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df74932c9d984dbd8d3f1bbcd9d75974)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:55.495378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:55.542205 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df74932c9d984dbd8d3f1bbcd9d75974', 'request_id': 'req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.550931 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df74932c9d984dbd8d3f1bbcd9d75974', 'request_id': 'req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.557527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df74932c9d984dbd8d3f1bbcd9d75974', 'request_id': 'req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.569773 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] The token cache is being invalidate because project df74932c9d984dbd8d3f1bbcd9d75974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:55.569941 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.570611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.572664 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1403/2825] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:55 2022] DELETE /identity/v3/projects/df74932c9d984dbd8d3f1bbcd9d75974 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:55.576750 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:55.586440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459b81-d81d-4c37-b086-d055ecefc8e7 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:55.647804 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:55.648808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:55.649096 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:55.649958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] PATH_INFO: `/v3/users/ec1a7a3b56e947aca4c47dc5a78697e3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:55.651194 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1a7a3b56e947aca4c47dc5a78697e3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:55.653091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:55.695121 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:55.703517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1a7a3b56e947aca4c47dc5a78697e3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.711619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1a7a3b56e947aca4c47dc5a78697e3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.713007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1a7a3b56e947aca4c47dc5a78697e3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.720370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1a7a3b56e947aca4c47dc5a78697e3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.732467 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1a7a3b56e947aca4c47dc5a78697e3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:55.738780 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1423/2826] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:55 2022] DELETE /identity/v3/users/ec1a7a3b56e947aca4c47dc5a78697e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:56.032185 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:56.033625 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:56.047260 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7bc2-0c5b-40f4-aeda-d537296ebb27 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:56.066324 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:56.110129 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:56.111151 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.111501 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.111851 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] PATH_INFO: `/v3/projects/f83468bf5687430fa3b46a110324ddab` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.113704 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83468bf5687430fa3b46a110324ddab)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:56.115025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:56.162478 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83468bf5687430fa3b46a110324ddab', 'request_id': 'req-8f966d23-bdc8-43fc-9bd1-069a636ff19c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.170729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83468bf5687430fa3b46a110324ddab', 'request_id': 'req-8f966d23-bdc8-43fc-9bd1-069a636ff19c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.176888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83468bf5687430fa3b46a110324ddab', 'request_id': 'req-8f966d23-bdc8-43fc-9bd1-069a636ff19c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.189326 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] The token cache is being invalidate because project f83468bf5687430fa3b46a110324ddab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:56.189617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.190301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.191831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1404/2827] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:56 2022] DELETE /identity/v3/projects/f83468bf5687430fa3b46a110324ddab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:56.195756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:56.197929 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:56.211173 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253e85-f367-4bd7-990e-5560935ce2be admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:56.269533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:56.270492 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.270707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.270986 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] PATH_INFO: `/v3/users/8f15c2804daa4cb5acba637215509b4c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.272176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f15c2804daa4cb5acba637215509b4c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:56.274105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:56.324786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f15c2804daa4cb5acba637215509b4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.332250 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f15c2804daa4cb5acba637215509b4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.332867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f15c2804daa4cb5acba637215509b4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.340127 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f15c2804daa4cb5acba637215509b4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.352761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-948c75ec-68c9-4a67-891b-81448a3803cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f15c2804daa4cb5acba637215509b4c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.359347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1424/2828] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:06:56 2022] DELETE /identity/v3/users/8f15c2804daa4cb5acba637215509b4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:06:56.621963 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:56.623831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:56.640626 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f966d23-bdc8-43fc-9bd1-069a636ff19c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:56.705909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:56.706913 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.707325 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.707783 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] PATH_INFO: `/v3/projects/77595fec9c1e438198608c3e7881bc99` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.709173 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77595fec9c1e438198608c3e7881bc99)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:56.711196 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:56.758718 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77595fec9c1e438198608c3e7881bc99', 'request_id': 'req-a90d5b35-f511-4a09-9df8-b425f04f5d6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.760421 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:56.768726 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77595fec9c1e438198608c3e7881bc99', 'request_id': 'req-a90d5b35-f511-4a09-9df8-b425f04f5d6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.782595 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77595fec9c1e438198608c3e7881bc99', 'request_id': 'req-a90d5b35-f511-4a09-9df8-b425f04f5d6d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.794830 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] The token cache is being invalidate because project 77595fec9c1e438198608c3e7881bc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:06:56.795146 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.795800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a90d5b35-f511-4a09-9df8-b425f04f5d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:06:56.797559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1405/2829] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:06:56 2022] DELETE /identity/v3/projects/77595fec9c1e438198608c3e7881bc99 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:56.803418 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.803573 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.803843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.822533 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:56.824129 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:56.854369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:06:56.886646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1425/2830] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:56.895217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.895592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.895948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.916295 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:56.917511 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:56.925502 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1406/2831] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:56.929925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:56.940007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3eec-b7da-42db-b15c-74e63b60ba3d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:56.944482 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:56.945135 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.945420 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.945700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.947060 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:06:56.947369 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:56.948961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:56.964016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1426/2832] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:06:56.965191 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:56.974938 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c4782-170b-4405-bcd4-b6f914b0c8ef None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:56.979829 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:56.980493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:56.980778 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:56.981109 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:56.981802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:56.983716 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.009888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1407/2833] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:06:56 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:57.014681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:57.025044 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa768e9-1dce-4acf-9a14-faa90df123be admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:57.083561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:57.084335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.084630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.084912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.085601 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:57.087535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.108144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1427/2834] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:06:57 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:06:57.112282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:57.125044 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdecdf5-c32f-40bf-a743-735fd265518f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:57.130507 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:57.131483 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.131933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.132279 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.133104 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:57.134904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.146464 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1408/2835] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:57.150452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:57.160697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dbd90-8579-4c21-9b15-4cc98a68d3d3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:57.166064 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:57.166760 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.167070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.167338 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.168066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:57.169663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378235-ee20-4258-ab99-74db043c41fe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.179925 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1428/2836] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:06:57.184675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:57.194533 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef793cbb-8b8b-4c9a-8aa3-2e70a09c8631 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:57.199386 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:57.200266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.200545 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.200816 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] PATH_INFO: `/v3/projects/c161b56b7c094b5e88084e54f2bf7863/users/0a6add8577c246b9a9d993c1fdaf8794/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.216182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c161b56b7c094b5e88084e54f2bf7863, user_id=0a6add8577c246b9a9d993c1fdaf8794, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:57.218892 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.232078 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1409/2837] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:06:57 2022] PUT /identity/v3/projects/c161b56b7c094b5e88084e54f2bf7863/users/0a6add8577c246b9a9d993c1fdaf8794/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:06:57.244808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.245322 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.245457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.272375 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] MFA Rules not processed for user `0a6add8577c246b9a9d993c1fdaf8794`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:06:57.274944 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:57.341875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1429/2838] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:06:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:06:57.352999 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:06:57.354911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:06:57.415233 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b543cb-1c55-41fe-bbcf-da97868ba092 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:06:57.418948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:06:57.419600 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:06:57.419888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:06:57.420311 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:06:57.428864 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:06:57.430912 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616b9f-8e73-4dc1-a085-dca3bec92c36 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:06:57.439807 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1410/2839] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:06:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:01.202238 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:01.203681 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:01.237646 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:01.269576 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594239d8-70d2-4156-8654-854b97e81e85 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:01.274016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:01.275429 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:01.275715 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:01.275989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] PATH_INFO: `/v3/users/82ac8161edf248bf8d2117de888b2105` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:01.277169 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ac8161edf248bf8d2117de888b2105)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:01.279105 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:01.323828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ac8161edf248bf8d2117de888b2105'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.330553 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ac8161edf248bf8d2117de888b2105'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.331176 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ac8161edf248bf8d2117de888b2105'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.338394 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ac8161edf248bf8d2117de888b2105'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.349770 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ac8161edf248bf8d2117de888b2105'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.356158 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1430/2840] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:07:01 2022] DELETE /identity/v3/users/82ac8161edf248bf8d2117de888b2105 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:01.360585 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418981-ef1b-441c-a287-5447df292e1c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:01.361070 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418981-ef1b-441c-a287-5447df292e1c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:01.361182 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418981-ef1b-441c-a287-5447df292e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:01.378272 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-01418981-ef1b-441c-a287-5447df292e1c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:01.379424 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-01418981-ef1b-441c-a287-5447df292e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:01.436347 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1411/2841] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:07:01.446155 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:01.447612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:01.503786 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259047cc-9d20-4962-8779-fb86e81fdeec admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:01.507507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:01.508154 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:01.508443 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:01.508722 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:01.518168 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:01.519612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:01.529711 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1431/2842] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:01.809649 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418981-ef1b-441c-a287-5447df292e1c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:01.811114 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-01418981-ef1b-441c-a287-5447df292e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:01.827509 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418981-ef1b-441c-a287-5447df292e1c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:01.833229 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:01.834106 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:01.834419 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:01.834701 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] PATH_INFO: `/v3/projects/574bbaa312e04bb0824f79e5ac6534fe` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:01.835932 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=574bbaa312e04bb0824f79e5ac6534fe)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:01.839032 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:01.850920 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:01.887806 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574bbaa312e04bb0824f79e5ac6534fe', 'request_id': 'req-28a78ebf-bb45-45de-93df-ab0584777d3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.895000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574bbaa312e04bb0824f79e5ac6534fe', 'request_id': 'req-28a78ebf-bb45-45de-93df-ab0584777d3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.901312 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574bbaa312e04bb0824f79e5ac6534fe', 'request_id': 'req-28a78ebf-bb45-45de-93df-ab0584777d3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.913373 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] The token cache is being invalidate because project 574bbaa312e04bb0824f79e5ac6534fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:07:01.913657 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.914319 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a78ebf-bb45-45de-93df-ab0584777d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:01.915873 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1412/2843] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:07:01 2022] DELETE /identity/v3/projects/574bbaa312e04bb0824f79e5ac6534fe => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:02.841705 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:02.843144 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:02.855762 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fca26-769e-4756-a6a8-8b49cf7db81f service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:02.902337 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:02.912331 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:02.913206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:02.913494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:02.913772 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] PATH_INFO: `/v3/users/0a6add8577c246b9a9d993c1fdaf8794` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:02.915031 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6add8577c246b9a9d993c1fdaf8794)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:02.917018 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:02.960641 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6add8577c246b9a9d993c1fdaf8794'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:02.967489 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6add8577c246b9a9d993c1fdaf8794'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:02.968161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6add8577c246b9a9d993c1fdaf8794'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:02.975802 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6add8577c246b9a9d993c1fdaf8794'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:02.988455 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6add8577c246b9a9d993c1fdaf8794'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:02.994889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1432/2844] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:07:02 2022] DELETE /identity/v3/users/0a6add8577c246b9a9d993c1fdaf8794 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:07:02.999363 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:02.999840 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:02.999965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.019000 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:03.020244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:03.077669 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1413/2845] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:03.087204 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.088655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:03.145883 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b11e-c47a-4aca-9e31-9fc8b1f330d8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.149565 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.150253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.150540 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.150817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.159725 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.161254 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c2fc-e3ef-4c20-ae7a-7a7dbe93ba9a service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.171118 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1433/2846] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:03.430656 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.432692 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:03.445771 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f21e8-f9b7-4720-a621-426887cb3505 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.451092 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.452010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.452320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.452597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] PATH_INFO: `/v3/projects/c161b56b7c094b5e88084e54f2bf7863` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.453876 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c161b56b7c094b5e88084e54f2bf7863)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.455714 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.501152 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c161b56b7c094b5e88084e54f2bf7863', 'request_id': 'req-f37d60a0-312e-47a6-be75-22741cfba28a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:03.508265 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c161b56b7c094b5e88084e54f2bf7863', 'request_id': 'req-f37d60a0-312e-47a6-be75-22741cfba28a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:03.514856 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c161b56b7c094b5e88084e54f2bf7863', 'request_id': 'req-f37d60a0-312e-47a6-be75-22741cfba28a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:03.525644 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] The token cache is being invalidate because project c161b56b7c094b5e88084e54f2bf7863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:07:03.525939 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:03.526611 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f37d60a0-312e-47a6-be75-22741cfba28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:03.528447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1414/2847] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:07:03 2022] DELETE /identity/v3/projects/c161b56b7c094b5e88084e54f2bf7863 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:03.533352 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.533663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.533961 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.551309 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:03.552518 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:03.609298 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1434/2848] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:03.616603 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.616896 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.617178 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.636002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:03.637201 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:03.645371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1415/2849] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:03.649372 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.658964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0b11-8c7a-4e00-911f-b79ece0fc4ce None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.663434 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.664107 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.664389 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.664665 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.665395 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:07:03.665815 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.667463 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.678911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1435/2850] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:07:03.683397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.692444 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc89f5-85e7-43fa-bce7-bf269dbaa940 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.697641 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.698315 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.698602 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.698880 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.699570 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.701441 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.714885 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:03.727948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1416/2851] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:07:03 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:07:03.731991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.737209 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:03.744165 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b49e-60b2-4d25-bd80-71efd5916c77 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.802013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.802707 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.802991 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.803266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.803952 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.805832 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.825273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1436/2852] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:07:03 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:07:03.829353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.839643 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27facaea-dc0c-46f6-9477-31dac3f2dce6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.844245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.844905 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.845188 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.845465 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.846221 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.847805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.858663 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1417/2853] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:07:03.862411 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.872829 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8076-414a-4b65-a4f5-bf3e4526595a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.877382 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.878034 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.878354 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.878632 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.879370 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.880932 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06577ffb-f689-46a6-a39c-238fbc7d4113 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.890868 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1437/2854] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:07:03.894911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:03.904539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2035aca-e9ed-4b81-ae35-a9d2466e9c48 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:03.909060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:03.909918 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.910301 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.910576 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] PATH_INFO: `/v3/projects/bc164c176c48441bb4eb4a0e6d79b94a/users/1cc277da650f4b02afa586880c748855/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.926064 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc164c176c48441bb4eb4a0e6d79b94a, user_id=1cc277da650f4b02afa586880c748855, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:03.928743 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:03.941790 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1418/2855] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:07:03 2022] PUT /identity/v3/projects/bc164c176c48441bb4eb4a0e6d79b94a/users/1cc277da650f4b02afa586880c748855/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:03.951745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:03.952039 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:03.952321 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:03.979484 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] MFA Rules not processed for user `1cc277da650f4b02afa586880c748855`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:03.980696 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:04.043046 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1438/2856] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:04.053622 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:04.055353 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:04.110052 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef675b-8fc3-4def-94b4-8667c69b76c9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:04.113881 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:04.114561 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:04.114843 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:04.115115 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:04.124204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:04.125629 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16a63-ecd9-44af-90dc-ad6ba6dd42b3 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:04.134523 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1419/2857] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:07.089747 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:07.150626 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27744df-2054-4209-809e-896e5000f5a4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:07.155091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:07.155957 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:07.156237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:07.156507 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] PATH_INFO: `/v3/users/1cc277da650f4b02afa586880c748855` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:07.157670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc277da650f4b02afa586880c748855)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:07.159584 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:07.171989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:07.205620 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc277da650f4b02afa586880c748855'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:07.213218 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc277da650f4b02afa586880c748855'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:07.213853 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc277da650f4b02afa586880c748855'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:07.220622 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc277da650f4b02afa586880c748855'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:07.233071 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc277da650f4b02afa586880c748855'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:07.239061 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1439/2858] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:07:07 2022] DELETE /identity/v3/users/1cc277da650f4b02afa586880c748855 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:07.243683 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:07.244172 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:07.244289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:07.261204 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:07.262447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:07.322953 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1420/2859] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:07.332513 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:07.334066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:07.390438 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632d3d-a699-49b7-a833-3565c944a561 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:07.394066 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:07.394745 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:07.395027 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:07.395305 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:07.404740 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:07.406186 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a2177-98c0-47a8-bb67-e058f0264f32 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:07.416011 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1440/2860] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:07.942468 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:07.943906 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:07.956354 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96c7de-b952-49e2-bc5a-6a9755ee1269 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:07.961342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:07.962393 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:07.962682 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:07.962960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] PATH_INFO: `/v3/projects/bc164c176c48441bb4eb4a0e6d79b94a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:07.964888 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc164c176c48441bb4eb4a0e6d79b94a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:07.967018 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.014633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc164c176c48441bb4eb4a0e6d79b94a', 'request_id': 'req-a3c94be0-1736-4d81-b888-185f32297a10'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:08.022010 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc164c176c48441bb4eb4a0e6d79b94a', 'request_id': 'req-a3c94be0-1736-4d81-b888-185f32297a10'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:08.023933 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:08.028475 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc164c176c48441bb4eb4a0e6d79b94a', 'request_id': 'req-a3c94be0-1736-4d81-b888-185f32297a10'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:08.040919 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] The token cache is being invalidate because project bc164c176c48441bb4eb4a0e6d79b94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:07:08.041203 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:08.041826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a3c94be0-1736-4d81-b888-185f32297a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:07:08.043357 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1421/2861] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:07:07 2022] DELETE /identity/v3/projects/bc164c176c48441bb4eb4a0e6d79b94a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:08.048197 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.048485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.048761 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.066081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:08.067285 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:08.125634 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1441/2862] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:08.134422 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.134711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.135480 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.153300 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:08.154525 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:08.162234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1422/2863] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:07:08.166236 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.175703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694128d-5a42-452c-8cc3-4ffb8e4e08cf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.180206 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.180852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.181630 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.181909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.182660 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:07:08.182970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.184554 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.196033 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1442/2864] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Jul 13 09:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:07:08.200559 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.209431 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3996d-5652-429d-a17d-acafa261108b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.213971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.214642 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.214923 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.215198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.215887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.217794 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.242454 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1423/2865] 10.222.0.49 () {60 vars in 1152 bytes} [Wed Jul 13 09:07:08 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:07:08.247070 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.256888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a25d1-84f6-4f9f-b9d8-5f6b7c0a1960 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.274164 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:08.313535 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.314229 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.314517 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.314798 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.315485 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.317376 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.336685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1443/2866] 10.222.0.49 () {60 vars in 1143 bytes} [Wed Jul 13 09:07:08 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:07:08.340729 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.350904 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c42b-cb33-4e18-a3bb-a12ded571980 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.355955 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.356605 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.356887 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.357160 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.357874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.359497 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.370065 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1424/2867] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:07:08.373856 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.383619 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2710eeb-deb0-465e-9fae-415e3a49aae6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.388440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.389081 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.389368 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.389648 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.390401 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.391964 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb732-8f02-4deb-8523-1243672fd0b8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.401651 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1444/2868] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 13 09:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:07:08.405399 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.414972 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8411-cd1a-42ee-87bb-39ac7b09bed0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.419996 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.420860 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.421143 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.421577 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] PATH_INFO: `/v3/projects/c1720b54c2d844f49d59fb9e8976dc13/users/32e388da7ec54259a25f2ec08c2d45b5/roles/4df88e7f9eda45a4921f67b10624be9e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.436247 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1720b54c2d844f49d59fb9e8976dc13, user_id=32e388da7ec54259a25f2ec08c2d45b5, role_id=4df88e7f9eda45a4921f67b10624be9e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.438882 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.451458 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1425/2869] 10.222.0.49 () {60 vars in 1482 bytes} [Wed Jul 13 09:07:08 2022] PUT /identity/v3/projects/c1720b54c2d844f49d59fb9e8976dc13/users/32e388da7ec54259a25f2ec08c2d45b5/roles/4df88e7f9eda45a4921f67b10624be9e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:07:08.456469 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311258-fb79-44ec-8cff-5ef6c9c6d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.456768 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311258-fb79-44ec-8cff-5ef6c9c6d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.457055 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311258-fb79-44ec-8cff-5ef6c9c6d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.474360 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-31311258-fb79-44ec-8cff-5ef6c9c6d5a7 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:08.475562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-31311258-fb79-44ec-8cff-5ef6c9c6d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:08.532843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1445/2870] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:08.542971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:08.544689 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:08.608254 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c351c-e742-403e-8adc-807a220c10c0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:08.611950 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:08.612592 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:08.612872 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:08.613144 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:08.622675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:08.624086 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:08.633244 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1426/2871] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:09.251266 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eace62-2a52-44de-9ad0-2cec03a0e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:09.251817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eace62-2a52-44de-9ad0-2cec03a0e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:09.251817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eace62-2a52-44de-9ad0-2cec03a0e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:09.277870 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d3eace62-2a52-44de-9ad0-2cec03a0e8b4 None None] MFA Rules not processed for user `32e388da7ec54259a25f2ec08c2d45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:09.279159 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d3eace62-2a52-44de-9ad0-2cec03a0e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:09.344348 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1446/2872] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:09.356224 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:09.357617 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:09.414526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e273-8a41-4073-bc73-c1908d43b922 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:09.418584 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a69afb9bc648a1badcc9a58d5f0e18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:09.419230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:09.419510 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:09.419781 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:09.429069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:09.430527 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:09.439826 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1427/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:10.775998 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:10.776500 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:10.776612 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:10.795670 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] MFA Rules not processed for user `32e388da7ec54259a25f2ec08c2d45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:10.796888 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:10.803636 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1447/2874] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:07:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:10.840524 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:10.842387 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:10.874817 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:10.920805 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dd3c2-8006-4844-8b69-49f8c0c19d65 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:10.924320 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7608808e60846798f9063d98cf7a7bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:10.924962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:10.925238 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:10.925516 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:10.927269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:10.997048 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:10.998439 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2926cfe-06a2-41a7-b77d-68a374baa6d0 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:11.009358 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1428/2875] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:11.521817 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:11.523237 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:11.535589 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59cb1c-0514-4e15-ac52-4bf4a9bd7220 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:11.540231 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:11.540912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:11.541201 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:11.541479 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:11.543362 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:11.557694 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:11.559174 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:11.570551 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1448/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:21.004447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=50 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:21.566203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:07:42.319675 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596f96-157a-40ff-a19c-e55c22629d20 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:42.320245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596f96-157a-40ff-a19c-e55c22629d20 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:42.320245 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596f96-157a-40ff-a19c-e55c22629d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:42.338447 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-49596f96-157a-40ff-a19c-e55c22629d20 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:42.339635 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-49596f96-157a-40ff-a19c-e55c22629d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:42.347940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1429/2877] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:42.363445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:42.365335 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:42.379568 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b5b6-23fb-4fca-9e23-06134e1860a3 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:42.384852 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:42.385483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:42.385764 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:42.386036 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:42.394882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:42.396424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:42.405613 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1449/2878] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:45.350504 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:45.350940 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:45.351066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:45.369269 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:45.370506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:45.378400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1430/2879] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:45.394082 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:45.395499 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:45.410466 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3be42-f4da-40b6-b778-bfda88583a5b service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:45.416076 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:45.416720 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:45.417006 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:45.417283 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:45.426091 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:45.427671 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bc049-cdb8-4de8-9d03-ef17f07c9a9e service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:45.436882 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1450/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:47.342072 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:47.351687 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be6c1-6c57-48a2-9c19-aec34e06ecb4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:47.355263 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:47.355911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:47.356194 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:47.356467 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:47.358756 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:47.368177 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:47.369537 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:47.378711 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1431/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:48.605179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1890-10ce-4e43-b242-2fcc7297141e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:48.605800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1890-10ce-4e43-b242-2fcc7297141e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:48.605800 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1890-10ce-4e43-b242-2fcc7297141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:48.745269 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-fd5c1890-10ce-4e43-b242-2fcc7297141e None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:48.746527 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fd5c1890-10ce-4e43-b242-2fcc7297141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:48.754995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1451/2882] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:07:48.769370 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:48.782198 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa50529-9757-41f4-9098-846d548df852 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:48.787613 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:48.788256 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:48.788542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:48.788821 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:48.797332 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:48.798928 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:48.808234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1432/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:51.683099 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f30d-9344-48ab-b426-659464c30e0a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:51.683597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f30d-9344-48ab-b426-659464c30e0a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:51.683717 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f30d-9344-48ab-b426-659464c30e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:51.701101 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b4a3f30d-9344-48ab-b426-659464c30e0a None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:51.702797 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b4a3f30d-9344-48ab-b426-659464c30e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:51.710408 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1452/2884] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:51.724965 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:51.735976 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9381166-f9c1-4deb-993f-11c880aecaca service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:51.741415 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:51.742055 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:51.742362 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:51.742638 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:51.750634 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:51.752202 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:51.761539 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1433/2885] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:55.862912 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797327-12db-4a58-90b8-8742fd6ac8a6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:55.863396 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797327-12db-4a58-90b8-8742fd6ac8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:55.863498 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797327-12db-4a58-90b8-8742fd6ac8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:55.880703 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f6797327-12db-4a58-90b8-8742fd6ac8a6 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:55.881896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f6797327-12db-4a58-90b8-8742fd6ac8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:55.890053 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1453/2886] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:55.906226 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:55.917289 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594788ed-411a-4c31-9ead-f15c9983a180 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:55.923471 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:55.924113 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:55.924400 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:55.924679 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:55.932749 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:55.934350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:55.943874 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1434/2887] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:59.018057 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:59.018828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:59.018828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:59.036414 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:07:59.037597 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:59.045299 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1454/2888] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:07:59.061440 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:59.072378 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f899-4453-4ab0-8772-29e7d03f4a71 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:59.077962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:59.078633 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:59.078911 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:59.079208 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:59.087222 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:59.088800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e0741-e92c-4d8a-96a9-84b859c868e9 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:59.098493 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1435/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:08.727473 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:08.739963 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2670ee1-3e69-4b7c-9a2a-6656a99f63b1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:08.745353 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:08.746123 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:08.746452 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:08.746756 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:08.748889 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:08.764074 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:08.765663 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:08.777483 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1455/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:08:09.094426 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=36 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:12.897025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:12.897598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:12.897598 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:12.915176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] MFA Rules not processed for user `32e388da7ec54259a25f2ec08c2d45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:12.916371 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:12.923136 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1436/2891] 10.222.0.49 () {58 vars in 957 bytes} [Wed Jul 13 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:13.156555 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:13.162029 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=31 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:13.168214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4d32d-7e74-4791-b755-a8013c1808fe service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:13.171911 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:13.172547 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:13.172825 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:13.173097 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:13.175023 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:13.184995 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:13.186424 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:13.196078 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1456/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:13.514802 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:13.516230 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:13.588103 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3f180-aa47-4bd0-a491-7108ffade36e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:13.593024 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:13.593670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:13.593954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:13.594266 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:13.596008 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:13.607108 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:13.608670 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f79dcf-5a39-4822-94c4-cefc81509e54 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:13.619030 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1437/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:20.373457 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:20.387652 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e61d-cd1f-4c38-b03c-949733dad4db service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:20.393843 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:20.394545 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:20.394827 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:20.395103 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:20.396860 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:20.409863 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:20.411594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:20.422562 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1457/2894] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:23.614712 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=35 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:25.916832 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9598d7-05ca-4fe8-85bb-83b2b4052a95 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:25.917481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9598d7-05ca-4fe8-85bb-83b2b4052a95 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:25.917481 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9598d7-05ca-4fe8-85bb-83b2b4052a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:25.935273 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6e9598d7-05ca-4fe8-85bb-83b2b4052a95 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:25.936459 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6e9598d7-05ca-4fe8-85bb-83b2b4052a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:25.944189 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1438/2895] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:25.970404 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:25.981896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070df8c3-30d3-423b-9311-fdeab4fbb0d5 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:25.987956 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:25.988592 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:25.988875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:25.989153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:25.997268 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:25.998875 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:26.008049 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1458/2896] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:29.160767 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159798d-f309-408f-9ac2-e3f5ea87c9f2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:29.161293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159798d-f309-408f-9ac2-e3f5ea87c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:29.161293 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159798d-f309-408f-9ac2-e3f5ea87c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:29.178724 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e159798d-f309-408f-9ac2-e3f5ea87c9f2 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:29.179909 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e159798d-f309-408f-9ac2-e3f5ea87c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:29.187597 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1439/2897] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:29.202273 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:29.214002 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c8b3-523e-4c64-8e76-440c2c526d72 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:29.219276 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:29.219899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:29.220177 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:29.220445 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:29.228945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:29.230501 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:29.239569 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1459/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:32.246803 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fcb86-6216-4a3d-a7a6-cbc750ed883c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:32.247284 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fcb86-6216-4a3d-a7a6-cbc750ed883c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:32.247394 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fcb86-6216-4a3d-a7a6-cbc750ed883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:32.265234 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f72fcb86-6216-4a3d-a7a6-cbc750ed883c None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:32.266466 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f72fcb86-6216-4a3d-a7a6-cbc750ed883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:32.274710 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1440/2899] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:32.289161 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:32.300319 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c9b3-47e3-493e-9fb7-2b8c421ae786 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:32.305672 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:32.306340 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:32.306627 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:32.306905 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:32.314862 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:32.316432 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:32.325729 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1460/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:35.396608 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d337c-82c0-499e-8882-383de4533ab3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:35.397105 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d337c-82c0-499e-8882-383de4533ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:35.397217 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d337c-82c0-499e-8882-383de4533ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:35.415344 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5b8d337c-82c0-499e-8882-383de4533ab3 None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:35.416548 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5b8d337c-82c0-499e-8882-383de4533ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:35.424569 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1441/2901] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:35.440079 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:35.451084 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d263e6-2867-48f1-ba52-135c778070b1 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:35.456333 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:35.457007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:35.457290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:35.457561 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:35.465606 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:35.467181 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:35.476909 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1461/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:38.559069 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:38.559547 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:38.559647 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:38.577176 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] MFA Rules not processed for user `251b3f8442ad41018807bed6ecb8c581`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:08:38.578397 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:38.586045 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1442/2903] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jul 13 09:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:08:38.602188 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:38.613867 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6907f-3cc2-4af1-b96c-e3b836f2315d service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:38.619291 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f847d12027be4164aff8449a2bd42750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:38.619970 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:38.620257 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:38.620532 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:38.628472 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:38.630016 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:38.639700 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1462/2904] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:38.829746 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:38.839878 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ca44-c79d-49f6-9239-507718dad79b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:38.843342 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:38.843979 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:38.844261 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:38.844536 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:38.846329 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:38.902799 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:38.904207 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:38.913691 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1443/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:08:43.540314 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:43.544685 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=42 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:43.550682 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063c95-5e1c-4fc1-91c9-28f04788d261 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:43.554828 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309b1c00398547b8b9924407e36bad8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:43.555494 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:43.555778 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:43.556059 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:43.557776 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:43.569984 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:43.571357 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:43.580821 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1463/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:48.908954 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=43 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:50.027839 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:50.030046 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:50.049060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b986-ce8c-4f5e-a9f1-a24c975f8fb0 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:50.055379 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:50.056282 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:50.056506 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:50.056800 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] PATH_INFO: `/v3/users/d0d227ce30ea4dd8832cd6536ddd5093` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:50.058200 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d227ce30ea4dd8832cd6536ddd5093)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:50.060131 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:50.120350 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d227ce30ea4dd8832cd6536ddd5093'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.128542 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d227ce30ea4dd8832cd6536ddd5093'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.130025 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d227ce30ea4dd8832cd6536ddd5093'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.138676 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d227ce30ea4dd8832cd6536ddd5093'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.151066 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d227ce30ea4dd8832cd6536ddd5093'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.157317 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1444/2907] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:08:50 2022] DELETE /identity/v3/users/d0d227ce30ea4dd8832cd6536ddd5093 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:08:50.334290 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:50.348510 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4a19-554f-4619-82b4-b53e20144f2d service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:50.417153 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:50.417958 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:50.418274 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:50.418558 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] PATH_INFO: `/v3/projects/44118768a2ce4f5b8ebcfa2352e2c915` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:50.419758 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44118768a2ce4f5b8ebcfa2352e2c915)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:50.421677 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:50.469701 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44118768a2ce4f5b8ebcfa2352e2c915', 'request_id': 'req-26c9bc6a-8272-45e0-99d8-f0ab40e48955'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.476475 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44118768a2ce4f5b8ebcfa2352e2c915', 'request_id': 'req-26c9bc6a-8272-45e0-99d8-f0ab40e48955'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.483007 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44118768a2ce4f5b8ebcfa2352e2c915', 'request_id': 'req-26c9bc6a-8272-45e0-99d8-f0ab40e48955'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.493728 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] The token cache is being invalidate because project 44118768a2ce4f5b8ebcfa2352e2c915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:08:50.494013 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.494676 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.496203 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1464/2908] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:08:50 2022] DELETE /identity/v3/projects/44118768a2ce4f5b8ebcfa2352e2c915 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:08:50.500210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:50.501618 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:50.515012 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96ad4f-5267-43b2-a1ed-52c0d0eccf15 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:50.571847 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:50.572719 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:50.573002 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:50.573280 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] PATH_INFO: `/v3/users/b148a699ba534df297340045cec3733a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:50.574526 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b148a699ba534df297340045cec3733a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:50.576438 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:50.620973 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b148a699ba534df297340045cec3733a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.628298 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b148a699ba534df297340045cec3733a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.629014 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b148a699ba534df297340045cec3733a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.636268 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b148a699ba534df297340045cec3733a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.644068 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:50.648734 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b148a699ba534df297340045cec3733a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.655831 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1445/2909] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:08:50 2022] DELETE /identity/v3/users/b148a699ba534df297340045cec3733a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:08:50.828210 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:50.829638 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:08:50.843989 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9bc6a-8272-45e0-99d8-f0ab40e48955 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:50.907787 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:50.908647 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:50.908930 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:50.909207 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] PATH_INFO: `/v3/projects/c6ef53b6c16140919fb24bf1180f310d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:50.910977 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ef53b6c16140919fb24bf1180f310d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:50.912841 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:50.934179 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:08:50.957287 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ef53b6c16140919fb24bf1180f310d', 'request_id': 'req-3ea09888-b151-4627-8dda-cf858d875543'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.963697 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ef53b6c16140919fb24bf1180f310d', 'request_id': 'req-3ea09888-b151-4627-8dda-cf858d875543'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.969655 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ef53b6c16140919fb24bf1180f310d', 'request_id': 'req-3ea09888-b151-4627-8dda-cf858d875543'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.980347 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] The token cache is being invalidate because project c6ef53b6c16140919fb24bf1180f310d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:08:50.980631 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.981253 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:08:50.982803 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1465/2910] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:08:50 2022] DELETE /identity/v3/projects/c6ef53b6c16140919fb24bf1180f310d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:00.652899 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:00.977520 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:09.557463 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:09.558962 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:09.572252 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a345530-14e7-49f9-98e8-fed76d6805c9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:09.626361 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:09.627165 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:09.627442 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:09.627709 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] PATH_INFO: `/v3/users/32e388da7ec54259a25f2ec08c2d45b5` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:09.629462 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e388da7ec54259a25f2ec08c2d45b5)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:09.631390 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:09.675992 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e388da7ec54259a25f2ec08c2d45b5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:09.683346 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e388da7ec54259a25f2ec08c2d45b5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:09.683960 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e388da7ec54259a25f2ec08c2d45b5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:09.690736 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e388da7ec54259a25f2ec08c2d45b5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:09.703060 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e388da7ec54259a25f2ec08c2d45b5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:09.708891 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1446/2911] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 13 09:09:09 2022] DELETE /identity/v3/users/32e388da7ec54259a25f2ec08c2d45b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:09.873994 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:09.875440 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:09.890594 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea09888-b151-4627-8dda-cf858d875543 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:09.952801 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251b3f8442ad41018807bed6ecb8c581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae57fca42c7a4eb0ba3859bea8e9d888', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:09.953661 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:09.953945 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:09.954259 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] PATH_INFO: `/v3/projects/c1720b54c2d844f49d59fb9e8976dc13` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:09.955430 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1720b54c2d844f49d59fb9e8976dc13)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:09.957355 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:10.002808 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1720b54c2d844f49d59fb9e8976dc13', 'request_id': 'req-69d1f287-e797-42a8-a8bb-fd8a55843b39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:10.009657 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1720b54c2d844f49d59fb9e8976dc13', 'request_id': 'req-69d1f287-e797-42a8-a8bb-fd8a55843b39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:10.015899 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1720b54c2d844f49d59fb9e8976dc13', 'request_id': 'req-69d1f287-e797-42a8-a8bb-fd8a55843b39'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:10.025896 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] The token cache is being invalidate because project c1720b54c2d844f49d59fb9e8976dc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:09:10.026214 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:10.026839 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-69d1f287-e797-42a8-a8bb-fd8a55843b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:10.028336 dv-cinder-849626-3-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1466/2912] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 13 09:09:09 2022] DELETE /identity/v3/projects/c1720b54c2d844f49d59fb9e8976dc13 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:19.705409 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:20.022980 dv-cinder-849626-3-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:09:49.160741 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:49.162175 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:49.228388 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b5db5-1b0f-4479-bd08-08ce0739def8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:49.284395 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169e5c77cc24a36ba0c3955b7637afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f6cec22d5b3470a9452bf1b2e442d6a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:49.285653 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:49.285948 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:49.287210 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:49.288901 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:49.299698 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:49.301276 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96087ca-938d-4efd-8b83-58a937477f03 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:49.310971 dv-cinder-849626-3-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1447/2913] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Jul 13 09:09:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:09:59.306812 dv-cinder-849626-3-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=58 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}